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TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, AND 

IMAGE PROCESSING PROGRAM 

5 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a technique of 

10 controlling an image processing apparatus including a 

document reader unit capable of reading a series of document 
sheets on a part-by-part basis, and an image output unit for 
outputting image data acquired via the reading performed by 
the document reader unit. 

15 Description of the Related Art 

[0002] A digital multifunction device having a printer 
function, a scanner function, a facsimile function, etc., is 
known in the art. In such digital multifunction devices, or 
a similar image processing apparatus, image data obtained 

20 via the scanning function, facsimile function, or PDL data 

received from a host computer can be stored in a storage 
device of the digital multifunction device. A desired image 
data can later be read from the storage device and printed. 
[0003] In using digital multifunction devices, when a given 

25 document set includes a series of sheets that is greater 
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than the number of sheets than can be placed on a document 
tray of the digital multifunction device, it is impossible 
to read all of the sheets at a single time. One known 
technique of circumventing this problem is to read the given 
5 document set on a part-by-part basis, and then combine the 

separately read parts into a single set of document image 
data. Reading of the document set on a part-by-part basis 
can be accomplished either by using the digital 
multifunction device's automatic document feeder or by 
10 placing each sheet of the document set on the document 

platen of the digital multifunction device. 

[0004] There are several methods for checking to ensure that 
reading of all the sheets of the document set was successful, 
i.e., that all the sheets were read correctly, that all the 

15 expected sheets are present, or that no extraneous sheets 

are present. In one case, r a hard copy of the document set is 
obtained by performing a test print after reading and 
storing of all the sheets of the document set has been 
completed. The hard copy is then reviewed to ensure that the 

20 reading was successfully performed. 

[0005] Another case involves image data that has been stored 
in the digital multifunction device's storage device after 
it was obtained by scanning an original document. In this 
case, it is possible to electronically preview the stored 

2 5 image data and perform editing such as deletion or insertion 
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of a page/sheet. However, previewing of the image can only 
be performed after the entire document has been scanned and 
stored. The ability to preview the image during the actual 
scanning operation is not available. 
5 [0006] It is currently known that digital copiers are 

capable of including a function that when an error is 
detected during a reading operation, a preview image of the 
page corresponding to the reading error can be displayed. 
That is, a preview image is available during the reading 

10 operation. This enables a user to confirm whether the page 

corresponding to the reading error is acceptable or not, 
which provides the user with an opportunity to decide 
whether to continue the copying operation without re-reading 
the page corresponding to the reading error. However, this 

15 particular feature of enabling previewing during the reading 
operation is a very limited one. Specifically, the copier is 
typically only stores one to two pages at any given time 
during the reading operation. Thus, the entire reading 
operation must still be completed in order for a user to be 

20 able to preview the entire document. 

[0007] Specific examples of such known techniques may be 
found, for example, in Japanese Laid-Open Patents 5-292268, 
2000-184110, or 10-200677 or Japanese Patent 3111621. 
[0008] As shown above, conventional digital multifunction 

25 devices do not provide the feature of enabling a user to 
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preview the entire image date of a document until all sheets 
of the document have been read. Even in the case where such 
a feature is provided, it is a very limited feature and is 
only available during a copying operation. If an error is 
5 detected after all the sheets have been read, it may be 

necessary to re-read a particular sheet or all the sheets. 
Therefore, after a plurality of document sheets are 
separately read as multiple batches of read image, the 
obtained image data is combined together and output as a 

10 series of document set, previewing is impossible until 

scanning of all document sets are completed. This is very 
inconvenient and inefficient for users. 
[0009] Confirmation by reading a document sheet on the 
platen and printing the resultant image data is also very 

15 inconvenient for a user, particularly when a given document 

set includes a large number of pages. In addition, an extra 
number of sheets are necessary for confirmation. 

SUMMARY OF THE INVENTION 

[0010] In view of the above, it is an object of the present 
invention to provide an image processing apparatus having a 
capability of displaying a preview image on a display even 
in the middle of a process of reading document pages. The 
image processing apparatus includes a binding reading mode, 



20 



25 
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in which a series of document sheets are divided into plural 
set of document sheets, each plural set is separately read, 
and each of the separately read plural sets are combined and 
stored as a series of read image. In one aspect, after each 
5 plural set is read, the read image is displayed before the 

next plural set is read. This allows a user to easily detect 
an error in read document data, wherein if a particular page 
of image data is detected to have an error, re-reading of 
that page is performed, and the page of image data having 
10 the error is replaced with the image data obtained by re- 

reading. After completion of the re-reading, reading of the 
remaining pages of the document set can continue in the 
binding reading mode . 

[0011] In an aspect, the present invention provides an image 
15 processing apparatus comprising image reading means for 

reading plural pages of a document, image storage means for 
storing image data produced by the image reading means, 
display means for displaying image data stored in the image 
storage means, and control means for controlling the reading 
20 operation for the plural pages of the document and 

displaying of image data on the display means such that the 
stored image data is displayed at an interval during the 
reading operation before completing the reading operation 
for the plural pages of the document. 
25 [0012] The image processing apparatus further comprising 
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means for executing a binding reading mode, wherein a series 
of document sheets are divided into a plural set of document 
sheets, each divided set of document sheets is separately 
read, and the plural set of image read by the plural reading 
5 operations are combined and stored as a series of read image, 

wherein the display interval is an interval between a first 
reading process for one divided set of document sheets and a 
second reading process for another divided set of document 
sheets . 

10 [0013] The image processing apparatus according to the 

present invention may further comprise command acceptance 
means for accepting a read-end command in the binding 
reading mode, wherein, in the binding reading mode, the 
control means is adapted to be capable of displaying image 

15 data stored in the image storage means on the display means 

before the command acceptance means accepts the read-end 
command . 

[0014] In the image processing apparatus according to the 
present invention, in the binding reading mode, the control 
20 means is capable of displaying image data stored in the 

image storage means on the display means before the second 
input process is started. 

[0015] In the image processing apparatus according to the 
present invention, in the binding reading mode, the control 
25 means is capable of displaying image data stored in the 



image storage means on the display means after completion of 
the first input process and before the second input process 
is started. 

[0016] The image processing apparatus according to the 
5 present invention may further comprise re-read means for re- 

reading a document page using the image reading means and 
replacing image data corresponding to image data currently 
displayed on the display means with image data obtained by 
the re-reading. 

10 [0017] In the image processing apparatus according to the 

present invention, in response to completion of the first 
input process, inputting of a command to display image data 
stored in the image storage means on the display means may 
be enabled. 

15 [0018] In the image processing apparatus according to the 

present invention, in response to completion of the first 
input process, inputting of a read-end command in the 
binding reading mode may be enabled. 

[0019] Further objects, features and advantages of the 
20 present invention will become apparent from the following 

description of the preferred embodiments with reference to 
the attached drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 



25 
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[0020] Fig. 1 is a block diagram showing an image processing 
system including an image processing apparatus according to 
an embodiment of the present invention. 

[0021] Fig. 2 is a cross-sectional view showing the details 
5 of a reader unit and a printer unit shown in Fig. 1. 

[0022] Fig. 3 is a block diagram showing the details of a 
controller of the reader unit shown in Fig. 1. 
[0023] Fig. 4 is a block diagram showing the details of the 
internal structure of a main controller shown in Fig. 3. 

10 [0024] Fig. 5 is a plan view showing an example of a display- 

screen of an operation control unit shown in Fig. 1. 
[0025] Fig. 6 is a plan view showing an example of a display 
screen of an operation control unit shown in Fig. 1. 
[0026] Fig. 7 a plan view showing an example of a display 

15 screen of an operation control unit shown in Fig. 1. 

[0027] Fig. 8 is a flow chart showing a first image data 
processing procedure performed by the image processing 
apparatus according to the present invention. 
[0028] Fig. 9 is a flow chart showing a second image data 

20 processing procedure performed by the image processing 
apparatus according to the present invention. 
[0029] Fig. 10 is a flow chart showing a third image data 
processing procedure performed by the image processing 
apparatus according to the present invention. 

25 [0030] Fig. 11 is a diagram showing the structure of 
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internal software of the controller shown in Fig. 1. 
[0031] Fig. 12 is a diagram showing an example of a module 
configuration of a job controller shown in Fig. 11. 
[0032] Fig. 13 is a diagram showing the configuration of a 
5 document manager for managing image data stored in a storage 

unit shown in Fig. 1. 

[0033] Fig. 14 is a diagram showing an example of a 
construction of a copy job, which is one of jobs executed by 
the controller shown in Fig. 1. 

10 [0034] Fig. 15 is a diagram showing an example of a manner 

in which attribute information is stored into the document 
manager when the copy job shown in Fig. 14 is executed. 
[0035] Fig 16 is a diagram showing an example of a control 
sequence of a copy job performed by the image processing 

15 apparatus according to the present invention. 

[0036] Fig 17 is a diagram showing an example of a control 
sequence of a copy job performed by the image processing 
apparatus according to the present invention. 
[0037] Fig. 18 is a diagram showing an example of a 

20 construction of an image conversion job executed by the 

controller shown in Fig. 1. 

[0038] Fig. 19 shows an example of a control sequence of an 
image conversion job performed by the image processing 
apparatus according to the present invention. 
25 [0039] Fig. 20 is a diagram showing a memory map of a 
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storage medium in which various data processing programs are 
stored in a manner readable by the image processing 
apparatus according to the present invention. 

5 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0040] The present invention is described in further detail 
below with reference to preferred embodiments in conjunction 
with the accompanying drawings . 

10 [0041] Fig. 1 is a block diagram showing an image processing 

system including an image processing apparatus according to 
an embodiment of the present invention. In this specific 
example shown in Fig. 1, the image processing apparatus 
according to the present invention is an image input/output 

15 system 100 connected to a first host computer 601 and a 

second host computer 602 via a LAN (Local Area Network) 600 
such as a Ethernet® LAN. The present invention is not 
limited to this means of connecting host computers 601 and 
602 with image input/output system 100 and any means of 

20 connecting host computers 601 and 602 with input/output 

system 100 that would enable practice of the present 
invention is applicable. 

[0042] The image input /output system 100 includes a reader 
unit 200 for reading image data, a printer unit 300 for 
2 5 outputting image data, an operation control unit 150 
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including a keyboard for inputting a command to control the 
operation of inputting or output ting image data, a liquid 
crystal panel (not shown) for displaying image data and 
associated information and for use in setting of operation 
5 condition, an image data storage unit 160 for storing image 

data read via the reader unit 200 or image data produced 
from code data received from the host computer 601 or 602 
via the LAN 600, and a controller 110 formed of a single 
electronic component for controlling the above elements 

10 connected to the controller 110. 

[0043] The reader unit 200 includes a document feeder (DF) 
250 for feeding a document sheet, and a scanner unit 210 for 
optically reading a document image and producing 
corresponding image data in the form of an electrical signal. 

15 The printer unit 300 includes a sheet feeder unit 310 with a 

plurality of paper cassettes in which stacks of printing 
paper are placed, a marking unit 320 for transferring image 
data to printing paper and fixing the transferred image, and 
a sheet feed-out unit 330 for sorting printed sheets, 

20 stapling sets of printed sheets, and outputting them to the 

outside . 

[0044] The controller 110 reads document data by controlling 
the reader unit 2 00 and prints the document data on printing 
paper by controlling the printer unit 300, thereby providing 
25 the copying function. 
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[0045] A scanner function is provided by reading image data 
using the reader unit 200, converting code data, and 
transmitting the resultant code data to the host computer 
601 or 602 via the network 600. A printer function is 
5 provided by converting code data received from the host 

computer 601 or 602 via the network 600 into image data and 
outputting the resultant image data to the printer unit 300. 
[0046] Fig. 2 is a cross-sectional view depicting the 
details of the reader unit 200 and the printer unit 300 

10 shown in Fig. 1. Elements in Fig. 2 that are the same as 

those in Fig. 1 are denoted by similar reference numerals. 
[0047] In the reader unit 2 00 shown in Fig. 2, document 
sheets stacked on the document feeder 250 are sequentially 
fed one by one from the top to the bottom of the stack onto 

15 platen glass 211, and image data thereof is read by the 

scanner unit 210. After completion of reading, the document 
sheet is transported from the platen glass 211 to an output 
sheet tray 219. 

[0048] When a document sheet is fed onto the platen glass 
20 211, a lamp 212 is turned on, and the optical unit 213 is 

moved. Thus, the document sheet is illuminated from below 
while being scanned, and reflected" light from the document 
sheet is directed to a CCD image sensor (hereinafter, 
referred to simply as a CCD) 218 via mirrors 214, 215, 216 
25 and a lens 217. Thus, the CCD 218 reads the document image. 



- 13 - 



The image data read by the CCD 218 is subjected to 
predetermined processing and the resultant image data is 
sent to a controller 110. 

[0049] In the case, in which the document feeder 250 has the 
5 flow-scanning capability, a document sheet fed from the 

stack on the document feeder 2 50 is passed through the flow- 
scanning position 240 at a constant speed. In this case, 
the optical unit 213 is moved to the flow-scanning position 
240 so that the document sheet being moved at the constant 
10 speed is illuminated by light emitted from the lamp 212, and 

reflected light is detected by the CCD 218, thereby 
producing image data. The resultant image data is sent to 
the controller 110. 

[0050] In the printer unit 300, a laser driver 321 drives a 
15 laser 322 in accordance with image data output from the 

controller 110. As a result, a laser beam with intensity 
corresponding to the image data is emitted from the laser 
322. When the laser beam contacts a photosensitive drum 323, 
an electrostatic latent image is formed thereon. Developing 
20 unit 324 develops the latent image by applying a developer 

to the latent image. 

[0051] In synchronization with laser 322 emitting the laser 
beam, printing paper is fed from one of a cassette 311, a 
cassette 312, cassette 313, a cassette 314, or a manual 
25 sheet feed tray 315 to an image transfer unit 325 via a 
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transport path 331, and the developer on the photosensitive 
drum 323 is transferred to the printing paper. After the 
image has been transferred to the printing paper, transport 
belt 326 transports the printing paper to a fixing unit 327. 
5 The fixing unit 327 fixes the image formed on the printing 

paper by means of heating and pressing. 

[0052] After passing through the fixing unit 327, the 
printing paper is output onto an output sheet bin 32 8 via a 
transport path 335 and a transport path 334. In a case in 

10 which the printing paper is output to the output sheet bin 

32 8 after the printing paper is turned over, the printing 
paper is transported to a transport path 33 6 and further to 
a transport path 338, and the printing paper is transported 
in a reverse direction to the output sheet bin 328 via a 

15 transport path 337 and a transport path 334. Although not 

shown in the figure, instead of the output sheet bin 328, an 
output sheet unit may be attached. The output sheet unit is 
capable of sorting printed sheets into plural sets of sheets 
and stapling each set of sheets. 

20 [0053] In a case in which printing is performed on both 

sides of paper, the printing paper is transported from the 
fixing unit 327 to the transport path 336. Thereafter, a 
flapper 329 directs the printing paper is to a transport 
path 333. The printing paper is then transported in the 

25 reverse direction to the flapper 329. The flapper 329 
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directs the printing paper to the transport path 338. Thus, 
the printing paper is transported to a re- feeding transport 
path 332. Thereafter, the printing paper is fed to the 
image transfer unit 325 via the transport path 331. 
5 [0054] Fig. 3 is a block diagram showing the details of the 

controller 110 of the reader unit 200 shown in Fig. 1. 
[0055] As shown in Fig. 3, a main controller 111 includes a 
CPU 112, a bus controller 113, and other functional blocks 
including various controllers that will be described later. 

10 The main controller 111 is connected to a ROM 114 via a ROM 

I/F 115, to a DRAM 116 via a DRAM I/F 117, and to a codec 
119 via a codec I/F 118. The main controller 111 is also 
connected to a network controller 121 via a network I/F 123, 
wherein the network controller 121 is connected to the LAN 

15 600 via a connector 122. 

[0056] In the ROM 114, various programs executed by the CPU 
112 in the main controller 111 and data necessary in 
executing the programs are stored. The DRAM 116 provides a 
work area for use by the CPU 112. The DRAM 116 is also used 

20 to store image data. The codec 119 compresses raster image 

data stored in the DRAM 116 by a known compression method 
such as MH, MR, MMR, or JBIG. The codec 119 also 
decompresses compressed image data into raster image data. 
The codec 119 is connected to a SRAM 120, which is used by 

2 5 the codec 119 as a work area. 
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[0057] The main controller 111 is also connected to a 
scanner I/F 140 via a scanner bus 141, to a printer I/F 145 
via a printer bus 146, and to an input/output controller 126 
and an extension connector 124 (for connection with an 
5 extension board) via a multipurpose high-speed bus 125 such 

as a PCI bus. 

[0058] The input/output controller 126 includes a 2-channel 
serial asynchronous communication controller 127 for 
transmitting and receiving a control command to or from the 

10 reader unit 200 or the printer unit 300. The serial 

communication controller 12 7 is connected to the scanner I/F 
140 and the printer I/F 145 via the I/O bus 128. 
[0059] The scanner I/F 140 is connected to a scanner 
connector 142 via a first asynchronous serial I/F 143 and a 

15 first video I/F 144. The scanner connector 142 is connected 

to the scanner unit 210 of the reader unit 200. 
[0060] The scanner I/F 140 performs processing on image data 
received from the scanner unit 210, such as conversion into 
2-level image data, and/or scaling up/down in the main 

20 scanning direction and/or in the sub scanning direction, and 

the scanner I/F 140 produces a control signal on the basis 
of the video signal received from the scanner unit 210. The 
resultant image data is transferred to the main controller 
111 via the scanner bus 141. 

25 [0061] The printer I/F 145 is connected to a printer 
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connector 147 via a second asynchronous serial I/F 148 and a 
second video I/F 149. The printer connector 147 is 
connected to the marking unit 320 of the printer unit 300. 
The printer I/F 145 performs a smoothing process on image 
5 data received from the main controller 111 and supplies the 

resultant image data to the marking unit 320. The printer 
I/F 145 also produces a control signal on the basis of a 
video signal received from the marking unit 32 0 and 
transmits the produced control signal over the printer bus 
10 146. 

[0062] The CPU 112 operates in accordance with a control 
program read from the ROM 114 via the ROM I/F 115. For 
example, the CPU 112 interprets PDL (Page Description 
Language) data received from the first host computer 601 or 
15 the second host computer 602 and converts the received PDL 

data into raster image data. 
[0063] The bus controller 113 controls 

transmission/reception of data to/ from external devices 
connected to the scanner I/F 140, the printer I/F 145, or 

20 the extension connector 124. More specifically, the bus 

controller 113 performs arbitration on usage of the bus and 
controls the DMA data transfer. For example, the data 
transfer between the DRAM 116 and the codec 119, the data 
transfer from the scanner unit 210 to the DRAM 116, and the 

25 data transfer from the DRAM 116 to the marking unit 320 are 
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performed in the DMA scheme under the control of the bus 
controller 113. 

[0064] The I/O controller 126 is connected to a panel I/F 
132 via a LCD controller 131 and a key input I/F 130. The 
5 panel I/F 132 is connected to the operation control unit 150. 

The I/O controller 12 6 is also connected to an EEPROM 135 
serving as a nonvolatile memory, to a hard disk drive (HDD) 
162 for writing/reading image data via an E-IDE connector 
161, and to a real time clock module 133 for providing data 
10 indicating the date/time used in the image processing 

apparatus. Backup battery 134 provides back-up power to 
real time clock module 133. 

[0065] Fig. 4 is a block diagram showing the details of the 
internal structure of the main controller 111 shown in Fig. 
15 3. 

[0066] As shown in Fig. 4, a processor core (CPU) 401 is 
connected to a system bus bridge (SBB) 402 via a 64 -bit 
processor bus (SCBus) . The SBB 402 is a 4 x 4 64-bit 
crossbar switch connected to a total of four buses, i.e., 

20 the SCBus for connection with the processor core 401, a 

local bus (MCBus) dedicated to connection with a memory 
controller 403 with a cache memory for controlling an SDRAM 
or a ROM, a graphic bus (GBus) 404, and a 10 bus (BBus) 405. 
[0067] The SBB 402 is designed so that the above-described 

2 5 four modules are connected as concurrently as possible. The 
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SBB 402 is also connected to a codec (data coder/decoder) 
418 via a codec I/F. 

[0068] The GBus 404 is connected to a scanner/printer 
controller (SPC) 408 for connection with the scanner or the 
5 printer, wherein the GBus 404 is controlled by a GBus 

arbiter (GBA) 406 so that the GBus 404 provides cooperative 
connection. The BBus 405 is connected to the SPC 408, a 
power management unit (PMU) 409, an interrupt controller 
(IC) 410, a serial interface controller (SIC) 411 using a 

10 UART, a USB controller 412, an IEEE12 84 parallel interface 

controller (PIC) 413, a Ethernet® LAN controller (LANC ) 414, 
a multipurpose input /output controller (MISC) 415, and a PCI 
bus interface (PCIC) 416, wherein the BBus 405 is controlled 
by a BBus arbiter (BBA) 407 such that the BBus 405 can 

15 provide cooperative connection with the above devices. 

[0069] The BBus arbiter 407 is an arbiter for controlling 
the BBus 405 such that the BBus 405 can provide cooperative 
connection. If the BBus arbiter 407 receives a request for 
use of the BBus 405, the BBus arbiter 407 performs 

20 arbitration such that only one selected master is enabled to 

use the BBus 405. This prevents the BBus 405 from being 
used by two or more masters at the same time. For the 
purpose of arbitration, three priority levels are defined 
and each master is assigned one of those three priority 

25 levels. 
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[0070] The interrupt controller 410 deals with external 
interrupts from the above described various functional 
blocks and the controller 110. Any external interrupt is 
first received by the interrupt controller 410 and then 
5 redistributed as a nonmaskable interrupt to controllers 408 

and 411 to 416 supported by the CPU 401. 
[0071] The power management unit 409 monitors the power 
consumption of the 1-chip controller 110 and controls the 
power consumption of each functional block. The controller 

10 110 is made of a large-scale ASIC (Application Specific 

Integrated Circuit), including the CPU 401. If all 
functional blocks in the controller 110 operate at the same 
time, a large amount of heat is generated, which may destroy 
the controller 110. 

15 [0072] To prevent the controller 110 from being destroyed by 

such overheating, the power management unit 409 acquires 
data indicating the power consumption (power management 
level) of each functional block, calculates the total power 
consumption, and controls the power consumption of each 

20 functional block so that the total power consumption is 

maintained lower than a maximum allowable value. 
[0073] The GBus arbiter 406 controls the GBus 404 by means 
of centralized arbitration so that the GBus 404 can be used 
cooperatively by bus masters. The GBus arbiter 406 performs 

2 5 arbitration using request signals and enables signals that 
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are uniquely defined for the respective bus masters. 
Priority is assigned to the respective bus masters selective 
in either an equal arbitration mode in which priority is 
equally assigned to all bus masters or in a priority 
5 arbitration mode in which, of various bus masters, a 

particular bus master is assigned high priority. 
[0074] Figs. 5 to 7 are plan views of the operation control 
unit 150 shown in Fig. 1, wherein some examples of the 
states of the display screen on the operation control unit 

10 150 are shown. 

[0075] In Fig. 5, reference numeral 500 denotes a user 
interface in the form of a liquid crystal touch panel. Via 
this user interface, a user can implement settings 
associated with various copying modes (e.g., double-sided 

15 printing, grouping, sorting, stapling, etc.). 

[0076] The mode setting means may be realized by either soft 
keys displayed on the touch panel or hard keys. Reference 
numeral 501 denotes a start button. If start button 501 is 
pressed, a copying process is initiated. 

20 [0077] Fig. 6 shows an example of a setting screen 502 for 

use in setting of reading conditions displayed on the user 
interface 500. This setting screen 502 appears if the 
binding reading mode is selected after the copying process 
is started by selecting the start button 501. If the 

25 binding reading mode is selected, all document pages are 
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read first before they are printed. 

[0078] As shown in Fig. 6, the setting screen 502 for use in 
setting reading conditions includes a "confirm" button 503 
and a "scanning completed" button 504. If the "confirm" 
5 button 503 is selected, the operation mode is switched into 

a preview mode in which images of read document data are 
displayed. If the "scanning completed" button 504 is 
selected, all read image data is output. 

[0079] Fig. 7 shows a preview image display screen that 
10 appears in response to selecting the "confirm" button 503 on 

the setting screen 502. 

[0080] In Fig. 7, the total number of pages of stored 
document image data and the page number of the page being 
currently displayed are displayed in a page information 

15 display area 505. If an arrow button 506 is pressed, the 

image being currently displayed is switched to a previous 
page. On the other hand, if an arrow button 507 is pressed, 
the image being displayed is switched to a next page. 
[0081] If a zoom out button 508 is pressed, the preview 

20 image is zoomed out. On the other hand, if a zoom in button 

509 is button is pressed, the preview image is zoomed in. 
[0082] The preview image of a document page specified in the 
page information display area 505 is displayed in a preview 
image display area 510. If a "re-scan" (re-read) button 511 

25 is pressed, data indicating the page corresponding to the 
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preview image being currently display is stored, and the 
preview image display screen 510 is closed. If the preview 
image display screen 510 is closed, the setting screen 502 
for setting of reading conditions again appears, and it 
5 becomes possible to read a document. 

[0083] If reading is performed in this state, reading is 
performed in the re-read mode. In Fig. 7, a "close" button 
512 is used to close the preview image display screen 510. 
If the preview image display screen 510 is closed in 

10 response to selecting the "close" button 512, the setting 

screen 502 for setting of reading conditions again appears, 
and it becomes possible to read a document. In this case, 
reading is performed in the binding rea'ding mode. 
[0084] As described above, in the binding reading mode , if 

15 one or more new document pages are read, the obtained image 

data is stored at a location after the end of the existing 
image data. After all document pages have been read, all 
image data is dealt with as a single set of image data. 
That is, in the binding reading mode, all image data 

2 0 obtained via a plurality of separate reading operations is 

combined together into a single set of image data and output 
to the printer unit 300. On the other hand, in the re-read 
mode, a particular page of stored image data is replaced 
with newly read image data. In any mode, reading is started 

25 in response to selecting the start button 501. 
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[0085] Fig. 8 is a flow chart showing a first image data 
processing process (in the binding reading mode) performed 
by the image processing apparatus according to the present 
invention. As previously described, in the binding 
5 reading mode, a series of document sheets are divided into a 

plural set of document sheets, each divided set of document 
sheets is separately read, and the plural set of image read 
by the plural reading operations are combined and stored as 
a series of read image. Note that the CPU 112 performs the 

10 steps of this process by executing a control program that is 

loaded into the DRAM 116 from the ROM 114 or the like. 
[0086] First, in step S1001, it is determined whether a 
start command has been issued ( i.e., selecting the start 
button 501) . In the case in which it is determined that a 

15 start command has not been issued, step S1001 is repeated 

until a start command is issued. 

[0087] If it is determined in step S1001 that a start 
command has been issued (i.e., button 501 has been selected), 
the process proceeds to step S1002. In step S1002, it is 

20 determined whether the binding reading mode is selected. If 

the binding reading mode is not selected, the process 
proceeds to step S1012. In step S1012, copying is performed 
in the normal mode. After completion of copying in step 
S1012, the process ends. 

25 [0088] On the other hand, in the case in which it is 
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determined in step S1002 that the binding reading mode is 
selected, the process proceeds to step S1003. In step S1003, 
reading of image data for document sheets sequentially fed 
from the automatic document feeder (DF) or for a document 
5 sheet put on the platen is performed. If reading is 

completed for all document sheets, issuing a command via the 
operation control unit 150 is enabled. Next, in step S1004, 
it is determined whether a command to display preview images 
of the document image data stored in the image storage unit 

10 160 has been issued. If it is determined that the command 

to display preview images has been issued, the process 
proceeds to step S1005. In step S1005, preview images are 
displayed. After completion of step S1005, the process 
proceeds to step S1006. In the above process, the 

15 displaying of preview images is allowed after completion of 

reading one divided set of document sheets and before 
completing the reading operation for all of the document 
sheets. In other words, the reading operation is preferably 
temporarily suspended between a first reading process for 

20 one divided set of document sheets and a second reading 

process for another divided set of document sheets when the 
preview images are displayed. If preview images are 
displayed in real time while the reader unit 200 is reading 
document images, the system has to execute both image 

25 processing for reading image and processing associated with 
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previewing image in parallel and the load to the system 
increases, thereby decreasing the system's operational 
performance. Also, the preview image being displayed is 
changes as the images are being read, thus making it 
5 difficult for a user to determine from the preview images 

whether document images have been correctly read and to 
determines whether to issue a re-read command. In the case 
in which the command to display preview images is not issued 
in step S1004, the process proceeds to step S1006. Any 
10 interval other than the preferred interval described above 

that would enable practice of the present invention is 
applicable . 

[0089] In step S1006, it is determined whether a re-read 
command has been issued. Note that the issuing of the re- 

15 read command is included in the preview image display step 

(step S1005), and if the re-read command is issued, data 
indicating the storage location of a page to be re-read is 
stored. In the case in which the re-read command has been 
issued, the process proceeds to step S1007. However, if the 

20 re-read command is not issued, the process proceeds to step 

S1008. 

[0090] In step S1007, the image data of the page specified 
to be re-read is discarded (i.e., deleted). Thereafter, the 
process returns to step S1003 to re-read the specified 
25 document page, and the old image data of that page is 
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replaced with the image data obtained via the re-reading. 
Thus, the user can easily replace the image data simply by 
issuing the re-read command without having to issue a delete 
command in addition to the re-read command. In the above 
5 process, if the re-read command is issued, only one page of 

document on the automatic document feeder is read and the 
image data corresponding to the current preview image is 
replaced with the image data obtained by the re-reading. 
This makes it possible for the user to easily understand 

10 what page is to be deleted and what is to be inserted in 

place of the deleted page. Although in the present example, 
only one page of image data is deleted and replaced with 
image data obtained by the re-reading, plural pages of image 
data may be replaced with corresponding pages of image data 

15 obtained by re-reading. 

[0091] In step S1003 described above, the reading of 
document image data can be performed not only for all 
document sheets sequentially fed from the automatic document 
feeder or placed on the platen, but also for a specified 

20 number of document sheets sequentially fed from the 

automatic document feeder. In the re-reading, the number of 
document sheets to be read is specified as one. 
[0092] In step S1008, it is determined whether a command to 
cancel the reading of the document image data in the binding 

25 reading mode has been issued. If it is determined that the 
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cancel command has been issued, the process proceeds to step 
S1009. In step S1009, all image data stored via the 
previous steps is deleted, and the copying process ends. 
[0093] On the other hand, in the case in which it is 
5 determined in step S1008 that the cancel command is not 

issued, the process proceeds to step S1010. In step S1010, 
it is determined whether a read-end command has been issued. 
[0094] If it is determined in step S1010 that the read-end 
command has been issued, the process proceeds to step S1011. 
10 In step S1011, all image data obtained vii the previous 

steps is printed. After completion of printing, the copying 
process ends. 

[0095] In the case in which it is determined in step S1010 
that the read-end command is not issued, the process 

15 proceeds to step S1013. In step S1013, it is determined 

whether the read command has been issued. If it is 
determined in step S1013 that the read command has been 
issued, the process returns to step S1003 to perform the 
document reading process. 

20 [0096] On the other hand, if it is determined in step S1013 

that the read command is not issued (i.e., selecting the 
start button 501), the process returns to step S1004. That 
is, in the case in which no command is issued via the 
operation control unit 150, the process waits in step S1004 

25 until one of commands including the preview image display 
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command, the re-read command, the cancel command, the read- 
end command, and the read command is issued. 
[0097] Fig. 9 is a flow chart showing a second image data 
processing process (document reading process) performed by 
5 the image processing apparatus according to the present 

invention. Note that the CPU 112 performs the steps in 
this process by executing a control program that is loaded 
into the DRAM 116 from the ROM 114 or the lik. 
[0098] First, in step S2001, the status of the automatic 

10 document feeder (DF) is detected. More specifically, it is 

determined whether the automatic document feeder is in a 
closed state or an open state. If it is determined that the 
automatic document feeder is in the open state, the process 
proceeds to step S2006. In step S2006, reading of document 

15 image data is performed for document sheets sequentially put 

on the platen. After completion of reading, the process 
ends . 

[0099] On the other hand in the case in which it is 
determined in step S2 001 that the automatic document feeder 

20 is in the closed state, the process proceeds to step S2002. 

In step S2002, it is determined whether a set of document 
sheets is placed on the automatic document feeder. If it is 
determined that no document is placed on the automatic 
document feeder, the process proceeds to step S2006. In 

25 step S2006, reading of document image data is performed for 
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a document sheet put on the platen. After completion of 
reading, the process ends. 

[0100] On the other hand, if it is determined in step S2002 
that a set of document sheets is placed on the automatic 
5 document feeder, the process proceeds to step S2003. In 

step S2003, it is determined whether a re-read command has 
been issued. If it is determined in step S2003 that the re- 
read command has been issued, the process proceeds to step 
S2004. In step S2004, one page of the document set is fed 

10 from the automatic document feeder and read. After 

completion of reading the one page, the process ends. In 
the above process, if the re-read command is issued, only 
one page of document on the automatic document feeder is 
read and the image data corresponding to the current preview 

15 image is replaced with the image data obtained by the re- 

reading. This makes it possible for the user to easily 
understand what page is to be deleted and what is to be 
inserted in place of the deleted page. Although in the 
present example, only one page is re-read, re-reading may be 

20 performed for a specified number of pages. 

[0101] In the case in which it is determined in step S2003 
that the re-read command is not issued, the process proceeds 
to step S2005. In step S2005, reading is performed for all 
pages of the document fed from the automatic document feeder. 

25 After completion of reading, the process ends. 



- 31 - 



[0102] Fig. 10 is a flow chart showing a third image data 
processing process (of displaying preview images) performed 
by the image processing apparatus according to the present 
invention. Note that the CPU 112 performs the steps in 
5 this process by executing a control program that is loaded 

into the DRAM 116 from the ROM 114 or the like. 
[0103] First, in step S3001, it is determined whether image 
data, which is stored at a particular storage location in 
the image storage unit, is specified to be previewed. 

10 [0104] The image data read in the binding reading mode is 

stored in the job manager 902 of the document manager 900 
shown in Fig. 13. Therefore, by specifying the job manager 
902, it is possible to read the image data stored therein 
from the first to last pages. 

15 [0105] If it is determined in step S3001 that no image data 

is specified to be previewed, the process ends without 
displaying any preview image. 

[0106] If it is determined in step S3 001 that a preview 
command has been issued, the process proceeds to step S3002. 
20 In step S3002, the first page of the stored image data is 

identified. In the next step S3 003, preview image data to 
be displayed in the preview image display screen 510 is 
produced from the stored image data. 

[0107] Although in the present embodiment, the preview image 
2 5 data is produced immediately before it is displayed in the 
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preview image display screen 510, the preview image data may 
be produced when document image data is acquired, and the 
produced preview image data may be stored together with the 
original image data in the external storage unit 160. 
5 [0108] In step S3 004, the preview image data produced in 

step S3 003 is displayed in the preview image display screen 
510. 

[0109] Then the process waits in step S3005 until a command 
is issued. If any command is detected, the process proceeds 

10 to step S3006. In step S3006, it is determined whether the 

issued command is a display-next-page command. If it is 
determined that the issued command is the display-next-page 
command, the process proceeds to step S3007. 
[0110] In step S3 007, it is determined whether the current 

15 page is the last page of the stored image data. If it is 

determined that the current page is the last page, the 
process returns to step S3005, and waits until another 
* command is issued. 

[0111] In the case in which it is determined in step S3007 

20 that the current page is not the last page, the process 

returns to step S3003. In step S3003, as described above, 
preview image data of a specified page is produced. 
[0112] In the case in which it is determined in step S3006 
that the issued command is not the display-next-page command, 

25 the process proceeds to step S3008. In step S3008, it is 
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determined whether the issued command is a display-previous- 
page command. If it is determined that the issued command 
is the display-previous -page command, the process proceeds 
to step S3009. In step S3009, it is determined whether the 
5 current page is the first page of the stored image data. If 

it is determined that the current page is the first page, 
the process returns to step S3005. The process waits in 
step S3 005 until any command is issued. 

[0113] In the case in which it is determined in step S3009 
10 that the current page is not the first page, the process 

returns to step S3003, in which preview image data of a 
specified page is produced. 

[0114] In the case in which it is determined in step S3008 
that the issued command is not the display-previous-page 

15 command, the process proceeds to step S3010. In step S3010, 

it is determined whether the issued command is a command to 
zoom out the image displayed in the preview image display 
screen 510. If so, the process returns to step S3003. In 
step S3003, scaled-down image data of the specified page is 

20 produced. 

[0115] In the case in which it is determined in step S3010 
that the issued command is not the zoom-out command, the 
process proceeds to step S3011. In step S3011, it is 
determined whether the issued command is a zoom-in command. 

25 If it is determined that the issued command is the zoom- in 
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command, the process returns to step S3003. In step S3003, 
scaled-up image data of the specified page is produced. 
[0116] In the case in which it is determined in step S3011 
that the issued command is not the zoom-in command, the 
5 process proceeds to step S3012. In step S3012, it is 

determined whether the issued command is a re-read command. 
If it is determined that the issued command is the re-read 
command, the process proceeds to step S3013. In step S3013, 
it is determined which location in the document manager 900 

10 the image data corresponding to the current preview image is 

stored at, and identification information indicating the 
location is stored. Thereafter, the process ends. The 
identification information stored in step S3013 is 
transferred to the image reading process described above, 

15 and re-reading is performed in accordance with the 

identification information. Thus, the user can replace the 
image data simply by issuing the re-read command without 
having to issue a delete command in addition to the re-read 
command. This is very convenient for the user. In the 

20 above process, when the re-read command is issued, only one 
page of document on the automatic document feeder is read 
and the image data corresponding to the current preview 
image is replaced with the image data obtained by the re- 
reading. This makes it possible for the user to easily 

25 understand what page is to be deleted and what is to be 
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inserted in place of the deleted page. Although in the 
present example, only one page of image data is deleted and 
replaced with image data obtained by the re-reading, plural 
pages of image data may be replaced with corresponding pages 
5 of image data obtained by re-reading. 

[0117] On the other hand, in the case in which it is 
determined in step S3 012 that the re-read command is not 
issued, the process returns to step S3005. The process 
waits in step S3 005 until any command is issued. 
10 [0118] Fig. 11 a diagram illustrating the structure of 

internal software of the controller 110 shown in Fig. 1. 
[0119] As shown in Fig. 11, software controller 700 includes 
a protocol interpreter 701, a job controller 702, and a 
device unit 703 . 

15 [0120] The protocol interpreter 701 interprets a command 

(protocol) received from the host computer 601 or the 
operation control unit 150 via the interfaces 411 to 414, 
and requests the job controller 702 to execute a job in 
accordance with the result of the interpretation. 

20 [0121] In response to the request from the protocol 

interpreter 701, the job controller 702 executes the job. 
[0122] The device unit 703 includes device drivers for 
controlling the respective physical device units of the 
image input/output system 100, wherein those device drivers 

25 are used by the job controller in executing the job. 
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[0123] Fig. 12 shows an example of a module configuration of 
the job controller 702 shown in Fig. 11. 

[0124] In Fig. 12, reference numeral 700 denotes the 
controller software, 701 denotes the protocol interpreter, 
5 7 02 denotes the job controller, and 7 03 denotes the device 

unit . 

[0125] The job controller 702 includes a job generator 800, 
a job processor 810, a document processor 820, a page 
processor 830, a band processor 840, and a device allocator 
10 850. 

[0126] The job processor 810 includes a job manager 811, a 
binder manager 812, and a document manager 813. The device 
unit 703 may include a plurality of devices. In the 
specific example shown in Fig. 12, the device unit 7 03 
15 includes a first device 851, a second device 852, and a 

third device 853. 

[0127] A request for operation is sent in the form of a 
command (protocol) from the host computer 601 or 602 or the 
operation control unit 150 via a corresponding interface 

20 (411 to 414) . The protocol interpreter 701 interprets the 

received command and the resultant interpreted command is 
supplied to the job controller 702. Note that when the 
command is supplied to the job controller 702, the protocol 
interpreter 701 converts the command into a form that can be 

25 understood by the job controller 702. 



- 37 - 

[0128] The job generator 800 generates a job 814. Herein, 
the job 814 generated by the job generator 800 can be one of 
various jobs including a copy job, a print job, a scan job, 
or a facsimile job. The protocol interpreted by the 
5 protocol interpreter 701 includes information indicating, 

for example in the case of the print job, the name of 
document to be printed, the number of copies, and the output 
sheet tray to which to output the printed sheets, and also 
includes print data (PDL data) . The generated job 814 is 
10 sent to the job processor 810, which processes the received 

job 814. 

[0129] The job processor 810 implements settings associated 
with the entirety of the job 814. The job manger 811 
implements settings associated with the job, such as the 

15 order of outputting binders that form the job. Each binder 

manager 812 implements settings associated with the 
corresponding binder, such as the order of outputting 
documents that form the binder. Each document manager 813 
implements settings associated with the corresponding 

20 document, such as the order of outputting pages that form 

the document . 

[0130] In the job processor 810, the job 814 is divided, 
except for the data indicating the setting (s) associated 
with the entirety of the job 814, into a plurality of 
25 portions called binders 815, and each binder 815 is divided, 



- 38 - 



except for the data indicating the settings associated with 
the entirety of the binder 815, into a plurality of still 
smaller portions called documents 816. 

[0131] Each document 816 is related, on a one-to-one basis, 
5 to a corresponding input document 821. The document 

processor 82 0 converts each input document 821 into an 
output document 822. For example, in the case of a scan job 
in which a set of document sheets is read by the scanner and 
converted into a plurality of image data, the input document 

10 821 is data indicating the setting (s) associated with the 

set of the document sheets and indicating the procedure to 
be performed, and the output document 822 is data indicating 
the setting (s) associated with the set of the image data and 
indicating the procedure to be performed. The document 

15 processor 820 serves to produce a set of image data from a 

set of sheets of paper of a given document. 
[0132] The document processor 820 converts the input 
document 821 into the output document 822, wherein the 
document processor 820 divides the document 816, except for 

20 the data indicating the setting (s) associated with the 

entirety of the document 816, into a plurality of still 
smaller portions called pages 831, and the document 
processor 820 requests the page processor 830 to process the 
pages 831. 

25 [0133] Dividing of a document into pages is analogous to 
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dividing of a job, performed by the job processor 810, into 
binders 815 and further into documents 816 so that the job 
processor 810 can deal with only the process associated with 
the entirety of the job. A specific example of document- 
5 level setting/processing is setting/processing associated 

with the order of pages such as sorting of pages, selection 
of double-sided printing, addition of a cover page, and 
insertion of transparency sheets . 

[0134] The page processor 830 converts each input page 831 
10 into an output page 832. For example, in the case of the 

scan job described above, each input page 831 includes data 
indicating setting/procedure such as the reading resolution 
and the reading direction (landscape or portrait) , while 
each output page 832 includes data indicating 
15 setting/procedure such as the storage location where to 
store the image data. 

[0135] The manner of dividing a job into a plurality of 
smaller and smaller portions finally into pages has been 
described above. If the system is allowed to have a page 
20 memory having a storage capacity of one page (provision of 
such a page memory results in an increase in cost of the 
system) , it is not necessary to further divide each page 
into smaller portions. 

[0136] However, when the system does not have a page memory 
25 having a storage capacity of one page, the job 814 is 



- 40 - 



processed using a memory (band memory) having a small 
storage capacity capable of storing only a few lines. In 
this case, each page is further divided into a plurality of 
portions called bands. More specifically, the band 
5 processor 840 converts each input band 841 into an output 

band 842 in a similar manner to the manner in which each 
page is processed. 

[0137] When the job processor 810, the document processor 
82 0, the page processor 830, and the band processor 840 

10 perform processing, they use various physical devices 

included in the image input/output system 100. 
[0138] If a plurality of these processors operate at the 
same time, competition occurs in terms of usage of the 
various physical devices. Device allocator 850 arbitrates 

15 the use of the devices. The first to third devices 851 to 

853 described above are logical devices allocated, by the 
device allocator 850, to the processors described above. 
Specific examples of devices include the page memory, the 
band memory, the document feeder 250, the marking unit 320, 

20 and the scanner unit 210. 

[0139] Fig. 13 shows the configuration of the document 
manager 900 for managing image data stored in the image 
storage unit 160 shown in Fig. 1. 

[0140] As shown in Fig. 13, the document manager 900 
25 includes the folder manager 901, the job manager 902, the 
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binder manager 903, the document manager 904, and the page 
manager 905, wherein each manager has its own management 
information (attribute information) . 

[0141] More specifically, the document manager 900 includes 
5 one or more folder managers 901 and has management 

information associated with each folder manager 901. Each 
folder manager 901 includes one or more job managers 902 and 
has management information associated with each job manager 
902. 

10 [0142] Each job manager 902 includes one or more binder 

managers 903 and has management information associated with 
each binder manager 903. Each job manager 902 can store 
attribute information which is stored in the job manager 811 
and which is necessary in processing the job 814 by the job 

15 controller 702. 

[0143] Each binder manager 903 includes one or more document 
managers 904 and has management information associated with 
each document manager 904. Each binder manager 903 can 
store attribute information which is stored in the binder 

2 0 manager 812 and which is necessary in processing the binder 

815 by the job controller 702. 

[0144] Each document manager 904 includes one or more page 
managers 905 and has management information associated with 
each page manager 905. Each document manager 904 can store 
25 attribute information which is stored in the document 
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manager 813 and which is necessary in processing the 
document by the job controller 702 and also store attribute 
information associated with the output document 822 
processed by the document processor 820. 
5 [0145] Each page manager 905 is related to one page of image 

data obtained via reading performed by the scanner and 
stored in the image storage unit 160, or one page of image 
data produced on the basis of PDL data received from the 
host computer 601 or 602, or one page of image data received 

10 from the facsimile unit. Each page manager 905 can store an 

attribute value associated with an output page 832 processed 
by the page processor 830 in the job controller 702. 
[0146] Thus, it is possible to reproduce the job 814, 
generated when the image data is stored, from the 

15 information stored in the document manager 900 and the image 

data stored in the image storage unit 160. It is also 
possible to execute the job in a manner different from the 
originally specified manner, by resetting the stored 
information. 

20 [0147] Fig. 14 shows an example of a copy job, which is one 

of jobs 814 executed by the controller 110 shown in Fig. 1. 
[0148] In Fig. 14, a request for operation is sent in the 
form of a command (protocol) from the host computer 601 or 
602 shown in Fig. 1 or from the operation control unit 150 

25 via a corresponding interface (411 to 414 shown in Fig. 4) . 
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[0149] The received command is interpreted by the protocol 
interpreter 7 01 and the resultant interpreted command is 
sent to the job controller 702. Note that when the command 
is supplied to the job controller 702, the protocol 
5 interpreter 7 01 has converted the command into a form that 

can be understood by the job controller 702. 
[0150] The job generator 800 interprets the received 
command and produces a copy job 1001. The job generator 800 
issues a request for executing the produced copy job 1001. 
10 The copy job 1001 has the capability of performing a copying 

process by producing a scan job 1002, an image agent job 
1003, and a print job 1006 and controlling those produced 
jobs . 

[0151] The image agent job 1003 divides itself into 
15 smaller portions, each of which divides itself into still 

smaller portions, and so on. More specifically, the image 
agent job 1003 produces image agent binders 1004 and 
requests the agent binders 1004 to perform the details of 
the process, and each image agent binder 1004 produces image 
20 agent documents 1005 and requests the image agent documents 

to perform the details of the process, and so on. The image 
agent document 1005 produces an image document 1011, which 
is an output document to be output by the document processor 
(paper — > image) 1010. The produced image document 1011 is 
25 sent to the scan job 1002 and the print job 1006 via the 
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image agent document 1005, the image agent binder 1004, the 
image agent job 1003, and the copy job 1001. 
[0152] The scan job 1002 produces a scan paper document 
1009, which is an input document to be input to a document 
5 processor (paper — > image) 1010, and then produces the 

document processor (paper — » image) 1010. When the document 
processor (paper — » image) 1010 is produced, the document 
processor (paper — » image) 1010 is informed that the scan 
paper document 1009 is specified as the input document and 

10 the image document 1011 is specified as the output document. 

Thereafter, the scan job 1002 requests the document 
processor (paper — > image) 1010 to process the scan paper 
document 1009 and controls the process performed by the 
document processor (paper — > image) 1010. 

15 [0153] In the scan job 1002, the job processor 810 

performs setting/processing associated with the entirety of 
the scan job 1002 and also performs setting/processing 
associated with binders. In the scan job 1002, the physical 
structure of the scanner unit 210 and that of the document 

20 feeder unit 250 allow one scanning operation to be 

controlled by one job, one binder, and one document, and 
thus, in the present embodiment, the binder 815 and the 
document 816 are omitted. 

[0154] In the scan paper document 1009, information 
25 associated with a document is managed in the form of 



- 45 - 



attribute information. In the image document 1011, 
information associated with image data obtained via the 
scanning process is managed in the form of attribute 
information. On the basis of those attribute information, 
5 the document processor (paper — > image) 1010 controls the 

process of converting the scan paper document 1009 given as 
the input document into the image document 1011 specified as 
the output document. 

[0155] The document processor (paper -» image) 1010 
10 performs only processing that should be performed on the 
document as a whole, but details of the processing are 
performed by the scan paper page 1017, the page processor 
(paper —> image) 1018, and the image page 1019. The scan 
paper document 1009 sequentially produces scan paper 1014 
15 corresponding to the respective original document sheets. 

[0156] When a scan paper 1014 is produced, an identifier 
thereof is registered in the scanner paper manger 1016 that 
manages the order of processing document pages. Thereafter, 
the scan paper 1014 produces a scan paper page 1017. The 
20 scan paper page 1017 corresponds to an upper-side page or a 

lower-side page of a document sheet. In the case in which 
each document sheet has images on both upper- side page and 
lower-side page, each scan paper 1014 produces two scan 
paper page 1017. 

25 [0157] The scanner paper manger 1016 determines the order 
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of processing scan paper pages 1017 on the basis of the 
identifier of the scan paper 1014 and the specifications 
(i.e., the scanning order) of the device. In the scan paper 
page 1017, information associated with the corresponding 
5 page of the document is described, and information 

associated with scanned image data of the corresponding page 
is described in the image page 1019 produced by the image 
document 1011. 

[0158] The page processor (paper — > image) 1018 controls 
10 the conversion from the scan paper page 1017 given as an 

input page into the image page 1019 specified as an output 

page. The page processor (paper — > image) 1018 controls the 

process sequence performed by the physical scanner device. 

More specifically, the page processor (paper — » image) 1018 
15 controls the document scanning operation by issuing an 

engine control command acceptable by the scanner device 

controller 1023. 

[0159] Furthermore, the attribute information described 
in the scan paper page 1017 and that described in the image 

2 0 page 1019 are set in the image processor 1025a thereby 

storing the image data of the document into the image 
storage unit 160. The document manager 900 manages the 
stored image data. The stored image data can be read, 
copied, moved, and deleted via the document manager 900. 

25 [0160] The image processors 1025a and 1025b include 
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control data associated with resolution conversion, code 
conversion, etc. 

[0161] The print job 1006 divides itself, except for 
setting/processing associated with the print job 1006 as a 
5 whole, into a plurality of portions called print binders 

1007, and further into a plurality of still smaller portions 
called print documents 1008, except for setting/processing 
associated with each printer binder 1007 as a whole. The 
print job 1006 controls the printing process by controlling 

10 the print binders 1007 and the print documents 1008. 

[0162] After the print document 1008 produces a print 
paper document 1013 as an output document to be output from 
a document processor (image — > paper) 1012, the printer 
document 1008 produces the document processor (image — > 

15 paper) 1012. At this stage of the processing, the document 

processor (image — > paper) 1012 is informed that the image 
document 1011 is specified as the input document and the 
print paper document. 1013 is specified as the output 
document. In response to a request from the print document 

20 1008, the document processor (image — > paper) 1012 performs 

processing under the control of the print document 1008. 
[0163] In the print paper document 1013, attribute 
information associated with print output is described, and 
attribute information associated with image data is 

25 described in the image document 1011. In accordance with 
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those attribute information, the document processor (image 
— > paper) 1012 controls the conversion from the image 
document 1011 given as the input document into the print 
paper document 1013 specified as the output document. The 
5 document processor (image — > paper) 1012 performs only 

processing associated with the document as a whole, but 
details of the processing are performed by the image page 
1019, the page processor (image — > paper) 1020, and the 
print paper page 1021. 

10 [0164] The print paper document 1013 sequentially 

produces as many print paper's 1015 as there are document 
pages to be printed. When each print paper 1015 is produced, 
the print paper 1015 registers its identifier in the print 
paper manager 1022 that controls the order of printing, and 

15 the print paper 1015 produces a print paper page 1021. The 

print paper page 1021 corresponds to an upper-side page or a 
lower-side page of a document sheet. In the case in which 
each document sheet has images on both upper- side page and 
lower-side page, each print paper 1015 produces two print 

20 paper pages 1021. 

[0165] The print paper manager 1022 determines the order 
of processing print paper pages 1021 on the basis of the 
identifiers of the print paper's 1015 and the specifications 
(i.e., the number of sheets internally circulated, the 

25 processing order for double-sided printing, etc.) of the 
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device. In each print paper page 1021, information 
associated with the page to be printed is described, and 
information associated with image data of the page is 
described in the image page 1019. The page processor (image 
5 —> paper) 1020 controls the conversion from the image page 
1019 given as the input page into the print paper page 1021 
specified as the output page. 

[0166] The page processor (image — > paper) 1020 controls 
the process sequence performed by the physical printer 

10 device. More specifically, the page processor (image — > 
paper) 1020 controls the printing operation by issuing an 
engine control command acceptable by the printer device 
controller 1024. Furthermore, the attribute information 
described in the image page 1019 and that described in the 

15 print paper page 1021 are set in the image processor 1025b 
thereby printing the image data stored in the image storage 
unit 160 on printing paper. 

[0167] As described above, the copying operation is 
accomplished in such a manner that the job is divided into 
20 smaller and smaller portions and processed by the 

corresponding processors. 

[0168] Fig. 15 is a diagram showing an example of a 
manner in which attribute information is stored into the 
document manager 900 when the copy job 1001 shown in Fig. 14 
25 is executed, wherein attribute information not shown in Fig. 
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14 is shown herein. 

[0169] As described above with reference to Fig. 13, the 
document manager 900 includes the folder manager 901, the 
job manager 902, the binder manager 903, the document 
5 manager 904, and the page manager 905, wherein those 

managers have their own management information (attribute 
information) . 

[0170] The attribute information, which is stored in the 
job manager 811 and which is necessary in performing the job 

10 814 by the job controller 702, is stored by the image agent 

job 1003 into the job manager 902 of the document manager 
900. The image agent binder 1004 stores the attribute 
information, which is stored in the binder manager 812 and 
which is necessary in performing the job 815 by the job 

15 controller 702, into the binder manager 903 of the document 

manager 900. The attribute information, which is stored in 
the document manager 813 and which is necessary in 
processing performed by the job controller 702 and the 
attribute information associated with the output document 

20 822 processed by the document processor 820 are stored, by 

the image document 1011 corresponding to the output document, 
into the document manager 904 of the document manager 900. 
The attribute information associated with the output page 
832 processed by the page processor 830 of the job 

25 controller 7 02 is stored, by the image page 1019 
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corresponding to the output page, into the page manager 905 
of the document manager 900. 

[0171] Referring to Figs. 16 and 17, an example of a 
control sequence of a copy job performed by the image 
5 processing apparatus according to the present invention is 

described below. 

[0172] Fig. 16 shows an example of a control sequence of 
a copy job performed by the image processing apparatus 
according to the present invention, wherein the part of 

.10 control sequence associated with the document management in 

the copy job is shown in Fig. 17. In Figs. 16 and 17, the 
control sequence associated with the scan paper document 
1009, the document processor (paper — > image) 1010, the 
image document 1011, the document processor (image — » paper) 

15 1012, and the print paper document 1013 is shown. 

Sequence in the Binding Reading Mode 

[0173] A request for an operation from the operation 
control unit 150 is sent in the form of a command (protocol) . 

20 The protocol interpreter 7 01 interprets the received command 

and the resultant interpreted command is sent to the job 
controller 702. Note that when the command is supplied to 
the job controller 702, the protocol interpreter 701 
converts the command into a form that can be understood by 

25 the job controller 702. 
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[0174] In step S4001, in accordance with the result of 
the interpretation, the protocol interpreter 701 requests 
the job generator 800 to generate a copy job 1001. In step 
S4002, in response to the request, the job generator 800 
5 generates the copy job 1001 and starts the copy job 1001 (in 

step S4003) . 

[0175] If the copy job 1001 is started in step S4003, 
then, in step S4004, the copy job 1001 requests the job 
generator 800 to generate a scan job 1002 that is needed in 

10 performing the copying process. 

[0176] In step S4005, in response to the request from the 
copy job 1001, the job generator 800 generates the scan job 
1002 and informs the copy job 1001 of the handle of the 
generated scan job 1002. By using this handle, the copy job 

15 1001 starts the generated scan job 1002 (in step S4006) . 

[0177] Furthermore, in step S4007, the copy job 1001 
requests the job generator 800 to generate a print job 1006. 
In step S4007, in response to the request from the copy job 
1001, the job generator 800 generates the print job 1006 and 

20 informs the copy job 1001 of the handle of the generated 

print job 1006. 

[0178] By using this handle, the copy job 1001 starts the 
generated print job 1006 (in step S4009) . Thereafter, in 
step S4010, the copy job 1001 requests the job generator 800 
25 to generate an image agent job 1003. 



- 53 - 



[0179] In step S4011, in response to the request from the 
copy job 1001, the job generator 800 generates the image 
agent job 1003 and informs the copy job 1001 of the handle 
of the generated image agent job 1003. By using this handle, 
5 the copy job 1001 starts the generated image agent job 1003 

(in step S4012) . 

[0180] The copy job 1001 performs a copying operation by 
controlling the scan job 1002, the image agent job 1003, and 
the print job 1006, which are produced via the above- 

10 described procedure. If the image agent job 1003 is started 

by the copy job 1001, the image agent job 1003 produces a 
folder, used to store attribute information, in the document 
manager 900 (step S4013 in Fig. 17) and produces a job (step 
S4014 in Fig. 17) . 

15 [0181] Thereafter, the protocol interpreter 701 registers 

binders of the job in the copy job 1001 (S4015) . If the 
binders are registers in the copy job 1001, the copy job 
1001 registers the binders in the image agent job 1003 
(S4016) . 

20 [0182] If the binders are registered in the image agent 

job 1003, the image agent job 1003 produces an image agent 
binder 1004 (S4017) and starts the produced image agent 
binder 1004 (S4018) . 

[0183] If the image agent binder 1004 is started by the 
25 image agent job 1003, the image agent binder 1004 produces a 
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binder for use in storing attribute information in the 
document manager 900 (S4029 Fig. 17) . Thereafter, the image 
binder 1004 informs the image agent job 1003 of the 
completion of the registration of the binder (S4020) . 
5 [0184] If the image agent job 1003 receives the 

notification of the completion of registration of the binder 
from the image agent binder 1004, the image agent job 1003 
notifies the copy job 1001 of the completion of the 
registration of the binder (S4021) . In response to 
10 receiving this notification, the copy job 1001 registers the 

binder in the scan job 1002 (S4022) and registers the binder 
in the print job 1006 (S4023). 

[0185] The protocol interpreter 701 registers documents 
of the binder in the copy job 1001 (S4024) . If the 
15 documents are registered in the copy job 1001, the copy job 

1001 registers the documents in the image agent job 1003 
(S4025) . 

[0186] If the documents are registered in the image agent 
job 1003, the image agent job 1003 registers the documents 
20 in the image agent binder 1004 (S4026) . If the documents 

are registered in the image agent binder 1004, the image 
agent binder 1004 produces an image agent document 1005 
(S4027) . 

[0187] If the image agent document 1005 is produced, the 
25 image agent document 1005 produces an image document 1011 
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(S4028) . Thereafter, the image agent binder 1004 starts the 
image agent document 1005 (S4029), and the image document 
1011 is started by the image agent document 1005 (S4030) . 
[0188] If the image document 1011 is started by the image 
5 agent document 1005, the image document 1011 produces a 
document of the document manger 900, for use in storing 
attribute information (S4031 in Fig. 17) . Thereafter, the 
image agent document 1005 is informed that the image 
document 1011 has been started (S4032) . 

10 [0189] If the image agent document 1005 is notified that 

the image document 1011 has been started, the image agent 
document 1005 notifies the image agent binder 1004 that the 
document has been started (S4033). In response, the image 
agent binder 1004 notifies the image agent job 1003 that the 

15 document has been started (S4034). In response, the image 

agent job 1003 notifies the copy job 1001 that the document 
has been started (S4035) . 

[0190] In response, the copy job 1001 registers the 
document in the scan job 1002 (S403 6) . If the document is 

20 registered in the scan job 1002, the scan job 1002 produces 

a scan paper document 1009 as an input document (S4037) and 
produces a document processor (paper — > image) 1010 that is 
to process the scan paper document 1009 as an input document 
so as to output the image document 1011 as an output 

2 5 document. 
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[0191] Thereafter, the order of printing image data in 
the image document 1011 specified as the output document is 
set (S4039), and the document processor (paper — > image) 
1010 is started (S4040). 
5 [0192] If the copy job 1001 receives the notification of 

the start of the document, the copy job 1001 registers the 
document in the print job 1006 (S4041) . Thereafter, the 
protocol interpreter 7 01 sends a document end command to the 
copy job 1001 (S4042) and a binder end command to the copy 

10 job 1001 (S4043) . 

[0193] In response, the image agent job 1003 is informed 
that the binder has been ended (S4044) . If the image agent 
job 1003 is informed that the binder has been ended, the 
image agent job 1003 informs the image agent binder 1004 

15 that there are no more documents to be registered (S4045) . 

[0194] If the image agent binder 1004 is informed that 
the registration of documents has been completed, the image 
agent binder 1004 notifies the image agent job 1003 that the 
binders have been established (S4046) , and the image agent 

20 job 1003 notifies the copy job 1001 that the binders have 

been established (S4047) . 

[0195] If the copy job 1001 is notified that the binders 
have been established, the copy job 1001 notifies the scan 
job 1002 (S4048) and the print job 1006 (S4049) that the 
25 binder has been ended. 



- 57 - 



[0196] The protocol interpreter 701 notifies the copy job 
1001 that the sequence of job scripts has been completed 
(S4050) . If the copy job 1001 is notified that the job 
scripts have been ended, the copy job 1001 informs the image 
5 agent job 1003 that the job scripts have been ended (S4051) . 

If the image agent job 1003 is notified that the job scripts 
have been ended, the image agent job 1003 notifies the copy 
job 1001 that the job has been established (S4052) . 
[0197] In response, the copy job 1001 notifies the scan 
10 job 1002 and the print job 1006 that the job scripts have 

been ended (steps S4053 and S4054) . 

[0198] On the other hand, if scanning of the document in 
the scanning process started in step S4040 is completed, the 
document processor (paper — > image) 1010 notifies the scan 
15 job 1002 that the scanning has been completed (S4055) . In 

response, the scan job 1002 notifies the copy job 1001 that 
scanning has been completed (S4056) . 

[0199] If the actual scanning of the image data is 
completed, the image document 1011 stores the attribute 

20 information in the document manager 900 (step S4057 in Fig. 

17), and the image document 1011 notifies the image document 
1005 that the attribute information has been stored (S4058) . 
If the image agent document 1005 is notified that the 
attribute information has been stored, the image agent 

25 document 1005 notifies the image agent binder 1004 that the 



- 58 - 



attribute information has been stored (S4059) . If the image 
agent binder 1004 is notified that the attribute information 
has been stored, the image agent binder 1004 stores the 
attribute information associated with the binder in the 
5 document manager 900 (S4060 in Fig. 17) . 

[0200] If the storing of the attribute information of the 
binder is completed in the above-described manner, the image 
agent binder 1004 notifies the image agent job 1003 that the 
storing of the attribute information is completed (S4061) . 

10 In response, the image agent job 1003 stores the attribute 

information in the document manager 900 (S4062 in Fig. 17) . 
After completion of storing the attribute information, the 
image agent job 1003 notifies the copy job 1001 that the 
attribute information has been stored (S4063) . 

15 [0201] In response, the copy job 1001 notifies the 

protocol interpreter 701 that the scanning is completed 
(S4064) . The protocol interpreter notifies the external job 
issuer (i.e., a host computer on the network or the 
operation control unit) that the scanning is completed. 

20 From the received notification, the job issuer can 

understand that the image data obtained via the scanning 
process has been stored. 

Sequence in the Binding Reading Mode 
25 [0202] The sequence in the binding reading mode is described 
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below. In the binding reading mode described above, if one 
or more new document pages are read, the obtained image data 
is stored at a location after the end of the existing image 
data. After completion of reading all document pages, all 
5 image data is dealt with as a single set of image data. 

[0203] First, the protocol interpreter 701 sends a scan 
command to the copy job 1001 (S4065) . In response to 
receiving the scan command, the copy job 1001 sends the scan 
command to the scan job 1002 (S4066) . In response, the scan 
10 job 1002 sends the scan command to the document processor 

(paper -> image) 1010 (S4067) . 

[0204] When scanning of the document fed from the DF or 
on the platen is completed, the document processor (paper — > 
image) 1010 informs the scan job 1002 that the scanning is 

15 completed (S4068) . In response, the scan job 1002 notifies 

the copy job 1001 that the scanning is completed (S4069) . 
If storing of the image into the document manger 900 is 
actually completed, the image document 1011 stores the 
attribute information into the document manager 900 (S4070 

20 in Fig. 17) , and the image document 1011 notifies the image 

agent document 1005 that the attribute information has been 
stored (S4071) . 

[0205] If the image agent document 1005 receives the 
notification indicating the attribute information has been 
25 stored, the image agent document 1005 notifies the image 
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agent binder 1004 that the attribute information has been 
stored (S4072). In response, the image agent binder 1004 
stores the attribute information associated with the binder 
into the document manager 900 (S4073 in Fig. 17) . After 
5 completion of storing the attribute information associate 

with the binder, the image agent binder 1004 notifies the 
image agent job 1003 that the storing of the attribute 
information is completed (S4074) . 

[0206] In response, the image agent job 1003 stores the 
10 attribute information into the document manager 900 (S4075 

in Fig. 17) . After completion of storing the attribute 
information, the image agent job 1003 notifies the copy job 
1001 that the attribute information has been stored (S4076) . 
[0207] In response, the copy job 1001 notifies the 
15 protocol interpreter 7 01 that the scanning is completed 

(S4077) . The protocol interpreter notifies the external job 
issuer (i.e., a host computer on the network or the 
operation control unit) so that the job issuer can recognize 
that storing of image data in the binding reading mode is 
20 completed. The above-described process can be performed 

repeatedly until the copy job 1001 is notified that the 
scanning is completed (S4095) . 

Sequence of Re-Scanning Operation 
25 [0208] A sequence of re-scanning process is described 
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below. As described earlier, re-scanning is performed to 
replace a particular already-stored image data with new 
image data obtained by re-scanning process. 
[0209] First, the protocol interpreter 701 sends a re- 
5 scan command to the copy job 1001 (S4078) . In response to 

receiving the re-scan command, the copy job 1001 sends a 
command to the image agent job 1003 to delete the specified 
image data (S4079) . If the image agent job 1003 receives 
the image data delete command,. the image agent job 1003 

10 sends the image data delete command to the image agent 

binder 1004 (S4080) . In response, the image agent binder 
1004 sends the image data delete command to the image agent 
document 1005 (S4081) . In response, the image agent 
document 100 5 sends the image data delete command to the 

15 image document 1011 (S4082) . The image document 1011 

detects an image page 1019 specified by the image data 
delete command from image pages managed by the image 
document 1011, and the image document 1011 sends the image 
data delete command to the detected image page 1019. Thus, 

20 the specified image data is actually deleted from the image 

storage unit 160. 

[0210] In the above process, the storage location of the 
associated attribute information in the document manager 900 
is also detected and the data indicating the storage 
25 location is stored. The copy job 1001 sends a scan command 
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to the scan job 1002 (S4083). The scan job 1002 sends the 
scan command to the document processor (paper — > image) 1010 

(S4084) . When scanning of the document fed from the DF or 
on the platen is completed, the document processor (paper — > 
5 image) 1010 notifies the scan job 1002 that the scanning has 

been completed (S4085) . In response, the scan job 1002 
notifies the copy job 1001 that scanning has been completed 

(S4086) . 

[0211] If storing the image data into the image storage 
10 unit 160 is completed, the image document 1011 stores 

attribute information at the same storage location in the 
document manager 900 as the storage location at which the 
attribute information of the deleted image data is stored 
(S4087 in Fig. 17), and the image document 1011 notifies the 
15 image agent document 1005 that the attribute information has 

been stored (S4088) . In response to receiving the 
notification indicating that the attribute information has 
been stored, the image agent document 1005 notifies the 
image agent binder 1004 that the attribute information has 
20 been stored (S4089) . In response to receiving the 

notification, the image agent binder 1004 stores the 
attribute information associated with the binder at the 
reserved location in the document manager 900 (S4090 in Fig. 
17) . 

25 [0212] If storing of the attribute information of the 
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binder is completed in the above-described manner, the image 
agent binder 1004 notifies the image agent job 1003 that the 
storing of the attribute information is completed (S4091) . 
In response, the image agent job 1003 stores the attribute 
5 information at the reserved location in the document manager 

900 (S4092 in Fig. 17) . After completion of storing the 
attribute information, the image agent job 1003 notifies the 
copy job 1001 that the attribute information has been stored 

(54093) . 

10 [0213] In response, the copy job 1001 notifies the 

protocol interpreter 701 that the scanning is completed 

(54094) . The protocol interpreter notifies the external job 
issuer (i.e., a host computer on the network or the 
operation control unit) so that the job issuer can recognize 

15 that the image data has been successfully obtained by the 

re-scanning and has been stored. Note that the re-scanning 
may be performed for one page or a plurality of pages. 

Sequence of Printing of Stored Image Data 
20 [0214] Now, the sequence of printing stored image data is 

described below. 

[0215] The protocol interpreter 701 informs the copy job 
1001 that the scanning is completed (S4095) . If the copy 
job 1001 is notified that the scanning is completed, the 
25 copy job 1001 issues a command to the print job 1006 to 
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output all image data that has been scanned and stored 

(54096) . In response to receiving the command to output the 
image data, the print job 1006 produces a print binder 1007 

(54097) and starts the produced print binder 1007 (S4098) . 
After starting the print binder 1007, the print job 1006 
registers the documents (S4099) . 

[0216] In response, the print binder 1007 produces a 
print document 1008 in step S4100 and starts the print 
document 1008 in step S4101. If the print document 1008 is 
started, the print document 1008 produces a print paper 
document 1013 as an output document (S4102) and the print 
document 1008 implements settings associated with reading of 
image data, such as the reading order (i.e., ascending order 
or descending order) , or designation of pages to be printed 
(i.e., specific pages or all pages) (S4103). 

[0217] Thereafter, in step S4104, the print document 1008 
produces a document processor (image — > paper) 1012 that is 
to convert the image document 1011 specified as the input 
document into the print paper document 1013 specified as the 
output document. In step S4105, the print document 1008 
starts the document processor (image — > paper) 1012. 
[0218] Via the steps described above, all image data, 
which is stored in the image storage unit 160 and which is 
managed by the image page 1019 under the control of the 
image document 1011, is printed. 
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[0219] In step S4106, the print job 1006 notifies the 
print binder 1007 that registration of documents is 
completed. Thus, this makes it possible for the print 
binder 1007 to determine which is the last one of print 
5 documents the print binder 1007 has to process. Although 

not shown in the figure, when each object completes a given 
process, the object notifies a higher-level object that the 
given process is completed. In turn, when the higher-level 
object completes processing of all objects it has produced 

10 and it deletes the objects, it notifies any higher-level 

object that the processing of all objects is completed. 
This is repeated from the lowest-level object to the 
highest-level object, and the copy job 1001 is eventually 
completed and deleted. 

15 [0220] In the above-described manner, reading in the 

binding reading mode, re-reading, and printing of stored 
image data are performed. 

[0221] Fig. 18 shows an example of an image conversion 
job that is one of jobs 814 executed by the controller 110 

20 shown in Fig. 1. This image conversion job is executed to 

produce preview image data from stored image data. 
[0222] In Fig. 18, a request for operation is sent in the 
form of a command (protocol) from the host computer 601 or 
602 or from the operation control unit 150 via a 

25 corresponding interface (411 to 414) . The protocol 
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interpreter 701 interprets the received command and the 
resultant interpreted command is sent to the job controller 
702 . 

[0223] Note that when the command is supplied to the job 
5 controller 702, the protocol interpreter 701 interprets the 

command into a form that can be understood by the job 
controller 702. The job generator 800 interprets the 
received command and produces an image conversion job 1001a. 
The job generator 800 issues a request for executing the 

10 produced image conversion job 1001a. The image conversion 

job 1001a has the capability of accomplishing the image 
conversion processing. More specifically, the image 
conversion job 1001a produces an input image agent job 1003, 
an output image agent job 1003', and an imaging job 1026, 

15 and accomplishes the image conversion by controlling these 

jobs . 

[0224] The input image agent job 1003 issues a request 
for performing a lower-level process to an input image agent 
binder 1004 and controls the processing performed by the 
20 input image agent binder 1004. In turn, the input image 

agent binder 1004 issues a request for performing a lower- 
level process to an input image agent document 1005 and 
controls the processing performed by the input image agent 
document 1005. 

25 [0225] The input image agent document 1005 produces an* 
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image document 1011 as an input document to be input to the 
document processor (image -» image) 1027, and the image 
document 1011 produces an image page 1019 corresponding to 
image data whose preview image is to be displayed in the 
5 preview screen area. The image page 1019 reads (acquires) 

the specified image data from the image storage unit 160. 
Similarly, the output image agent job 1003' issues a request 
for performing a lower-level process to an output image 
agent binder 1004' and controls the processing performed by 

10 the output image agent binder 1004'. The output image agent 

binder 1004' in turn issues a request for performing a 
lower-level process to an output image agent document 1005' 
and controls the processing performed by the output image 
agent document 1005'. 

15 [0226] The output image agent document 1005' produces an 

image document 1011 1 as an output document to be output from 
the document processor (image — > image) 1027. The image 
document 1011 1 produces an image page 1019' corresponding to 
preview image data that is to be acquired via the image 

20 conversion. The image data obtained via the image 

conversion is stored in the image storage unit 160. 
[0227] The produced image document 1011' is transferred 
to the imaging job 1026 via the output image agent document 
1005', the output image agent binder 1004 1 , the output image 

25 agent job 1003', and the image conversion job 1001a. 
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[0228] When the imaging job 1026 produces the document 
processor (image — » image) 1027, the imaging job 1026 
specifies the image document 1011 as the input document to 
be input to the document processor (image -> image) 1027 and 
5 specifies the image document 1011 1 as the output document. 

The imaging job 1026 issues a request for processing to the 
document processor (image — > image) 1027 and controls the 
processing performed by the document processor (image — > 
image) 1027. 

10 [0229] Also in the imaging job 1026 as in the scan job 

1002, setting/processing associated with the entirety of the 
imaging job 1026 and the setting/processing associated with 
the binder is performed by the job processor 810, and thus 
the binder 815 and the document 816 are omitted herein. 

15 [0230] In the input image document 1011, attribute 

information associated with the image data stored in the 
image storage unit is described. On the other hand, in the 
output image document 1011', attribute information 
associated with the image data to be converted into the 

20 preview image data is described. In accordance with this 

attribute information, the document processor (image — » 
image) 1027 controls the conversion from the image document 
1011 given as the input document into the image document 
1011 1 specified as the output document. 

25 [0231] The document processor (image -» image) 1011 
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performs only processing associated with the document as a 
whole, but details of the processing are performed by the 
image page 1019, the page processor (image — > image) 1028, 
and the image page 1019'. The image document 1011 produces 
5 an image page 1019 corresponding to a particular page or all 

pages belonging to the document manager 904 in the document 
manager 900. 

[0232] In the image page 1019 produced by the image 
document 1011, information associated with each page of the 

10 stored image data is described. The page processor (image 

— » image) 1028 controls the conversion from the image page 
1019 given as the input page into the image page 1019' 
specified as the output page. The page processor (image — > 
image) 102 8 has the capability of controlling the operation 

15 sequence of the image processing device and performs the 

image conversion by controlling the operation sequence of 
the image processing device. 

[0233] As described above, the image conversion is 
accomplished by performing the processing in the 
20 hierarchical manner in which the job is divided into smaller 

and smaller portions and processed by the corresponding 
processors . 

[0234] Fig. 19 shows an example of a control sequence of 
an image conversion job performed by the image processing 
25 apparatus according to the present invention. In this 
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example, the control sequence associated with the input 
image document 1011, the document processor (image — » image) 
1027, and the output image document 1011 1 is shown. 
[0235] A request for an operation from the operation 
5 control unit 150 is output in the form of a command 

(protocol) . The protocol interpreter 701 interprets the 
received command and the resultant interpreted command is 
sent to the job controller 702. Note that when the command 
is supplied to the job controller 702, the protocol 

10 interpreter 701 converts the command into a form that can be 

understood by the job controller 702. 
[0236] In accordance with the result of the 
interpretation of the command, the protocol interpreter 701 
issues, in step S5001, a request for generation of an image 

15 conversion job 1001b to the job generator 800. In step 

S5002, in response to receiving the request, the job 
generator 800 generates the image conversion job 1001a and 
starts it (S5003) . If the image conversion job 1001a is 
started in step S5003, then, in step S5004, the image 

20 conversion job 1001a issues a request for generation of an 

input image agent job 1003 to the job generator 800. 
[0237] In step S5005, in response to receiving the 
request from the image conversion job 1001a, the job 
generator 800 generates the input image agent job 1003 and 

25 sends data indicating the handle of the generated input 
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image agent job 1003 to the image conversion job 1001a. 
[0238] By using the handle, the image conversion job 
1001a starts the generated input image agent job 1003 
(S5006) . 

5 [0239] In step S5007, the image conversion job 1001a 

issues a request for generation of an output image agent job 
1003' to the job generator 800. In step S5008, in 
accordance with the request from the image conversion job 
1001a, the job generator 800 generates the output image 
10 agent job 1003' and sends data indicating the handle of the 

generated output image agent job 1003' to the image 
conversion job 1001a. 

[0240] By using this handle, the image conversion job 
1001a starts the generated output image agent job 1003' 

15 (S5009) . If the output image agent job 1003' is started, 

then, in step S5010, the output image agent job 1003' 
produces a folder for use in storing attribute information 
in the document manger 900. Subsequently, in step S5011, 
the output image agent job 1003' produces a job. 

20 [0241] In step S5012, the image conversion job 1001a 

issues a request for generation of an imaging job 1026 to 
the job generator 800. In step S5013, in accordance with 
the request from the image conversion job 1001a, the job 
generator 800 generates the imaging job 1026 and sends data 

25 indicating the handle of the generated imaging job 1026 to 



the image conversion job 1001a. 

[0242] By using this handle, the image conversion job 
1001a starts the generated imaging job 1026 (S5014) . 
[0243] The image conversion job 1001a performs the image 
conversion by controlling the input image agent job 1003, 
the imaging job 1026, and the output image agent job 1003', 
generated in the above-described manner. 

[0244] Thereafter, the protocol interpreter 701 registers 
binders forming the job in the image conversion job 1001a, 
(S5015) . After completion of registration of the binders in 
the image conversion job 1001a, the image conversion job 
1001a registers the binders in the output image agent job 
1003 1 (S5016) . 

[0245] If the binders are registered in the output image 
agent job 1003', the output image agent job 1003' produces 
an output image agent binder 1004' in step S5017. In step 
S5018, the output image agent job 1003' starts the output 
image agent binder 1004'. 

[0246] If the output image agent binder 1004' is started 
by the output image agent job 1003', the output image agent 
binder 1004' produces a binder for use in storing attribute 
information in the document manager 900 (S5019) . Thereafter, 
the output image agent binder 1004' notifies the output 
image agent job 1003' that registration of binders is 
completed (S5020) . 
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[0247] If the output image agent job 1003' receives, from 
the output image agent binder 1004' , the notification 
indicating that the registration of binders is completed, 
the output image agent job 1003' notifies the image 
5 conversion job 1001a that the registration of the binders is 

completed (S5021) . In response to receiving the 
notification, the image conversion job 1001a registers the 
binders in the input image agent job 1003 (S5022). 
[0248] After completion of the registration of the 
10 binders in the input image agent job 1003, the input image 

agent job 1003 produces an input image agent binder 1004 in 
step S5023. In step S5024, the input image agent job 1003 
starts the input image agent binder 1004. 

[0249] If registration of binders is completed, the input 
15 image agent binder 1004 notifies the input image agent job 

1003 that the registration of binders is competed (S5025) . 
[0250] If the input image agent job 1003 receives, from 
the input image agent binder 1004, the notification 
indicating that the registration of binders is completed, 
20 the input image agent job 1003 notifies the image conversion 

job 1001a that the registration of the binders is completed 
(S502 6) . In response to receiving the notification, the 
image conversion job 1001a registers the binders in the 
imaging job 1026 (S5027) . 
25 [0251] Thereafter, the protocol interpreter 701 registers 
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documents forming the binder in the image conversion job 
1001a (S5028) . If registration of the documents in the 
image conversion job 1001a is completed, the image 
conversion job 1001a registers the documents in the output 
5 image agent job 1003' (S5029), and the output image agent 

job 1003 1 registers the document in the output image agent 
binder 1004' (S5030) . 

[0252] If the registration of the documents in the output 
image agent binder 1004' is completed, the output image 
10 agent binder 1003' produces an output image agent document 

1005' (S5031) , and the output image agent document 1005' 
produces an image document 1011' (S5032). 

[0253] The output image agent document 1005' implements 
settings associated with the produced image document 1011 1 

15 in terms of reading of image data, such as the reading order 

(ascending order or descending order) , or designation of 
pages to be printed (specific pages, or all pages) (S5033). 
[0254] Thereafter, the output image agent binder. 1004' 
starts the output image agent document 1005' (S5034) . In 

20 response, the output image agent document 1005' starts the 

image document 1011 1 (S5035) . 

[0255] If the image document 1011' is started by the 
output image agent document 1005', the image document 1011' 
produces a document for use in storing attribute information 
25 in the document manager 900 (S5036). 
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[0256] In step S5037, the image document 1011' notifies 
the output image agent document 1005' that the document has 
been started. The notification of the start of the document 
is sent from the output agent document 1005' to the output 
5 image agent binder 1004' in step S5038, from the output 

image agent binder 1004' to the output image agent job 1003* 
in step S5039, and from the output image agent job 1003' to 
the image conversion job 1001a in step S5040. 
[0257] If the image conversion job 1001a receives the 

10 notification indicating that the output document has been 

started, the image conversion job 1001a registers the 
document in the input image agent job 1003 (S5041) . 
[0258] If the document is registered in the input image 
agent job 1003, the input image agent job 1003 registers the 

15 document in the input image agent binder 1004 (S5042). 

[0259] If the document is registered in the input image 
agent binder 1004, the input image agent binder 1003 
produces an input image agent document 1005 (S5043), and the 
input image agent document 1005 produces an image document 

20 1011 (S5044) . 

[0260] The input image agent document 1005 implements 
settings in terms of writing of image data in the image 
document 1011 (S5045) . Thereafter, the input image agent 
binder 1004 starts the input image agent document 1005 

25 (S5046), and the input image agent document 1005 starts the 
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image document 1011 (S5047) . 

[0261] If the image document 1011 is started, the image 
document 1011 notifies the input image document 1005 that 
the document has been started (S5048) . The notification of 
5 the start of the document is sent from the input image agent 

document 1005 to the input image agent binder 1004 in step 
S5049, from the input image agent binder 1004 to the input 
image agent job 1003 in step S5050, and from the input image 
agent job 1003 to the image conversion job 1001a in step 
10 S5051. 

[0262] In response to receiving the notification, the 
image conversion job 1001a registers the document in the 
imaging job 102 6 (S5052) . When the document is registered 
herein, the imaging job 102 6 is also notified that the image 

15 document 1011 is specified as the input document and the 
image document 1011' is specified as the output document. 
[0263] If the document is registered in the imaging job 
1026, the imaging job 102 6 implements settings in terms of 
reading image data from the image document 1011 specified as 

20 the input document (S5053) and implements settings in terms 

of writing image data into the image document 1011 1 
specified as the output document (S5054) . 
[0264] Thereafter, the imaging job 102 6 produces a 
document processor (image — > image) 1027 wherein the image 

25 document 1011 is specified as the input document and the 
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image document 1011' is specified as the output document 
(S5055) . After completion of producing the document 
processor (image — » image) 1027, the imaging job 1026 starts 
the document processor (image — > image) 1027 to perform the 
5 image conversion (S5056) . 

[0265] In the above process, information indicating the 
storage location at which the image data is stored is 
supplied to the image page (not shown in the figure) so that 
the image data can be read from the image storage unit 160 
10 via the document manager 900 on the basis of the supplied 

information. 

[0266] Thereafter, the protocol interpreter 701 sends a 
document end command to the image conversion job 1001a in 
step S5057 and further sends a binder end command in step 
15 S5058. 

[0267] If the image conversion job 1001a receives the 
document end command, the image conversion job 1001a issues 
a binder end command to the output image agent job 1003' 
(S5059) . 

20 [0268] In response to receiving the binder end command, 

the output image agent job 1003' notifies the output image 
agent binder 1004' that there is no more documents to be 
registered (S5060) . 

[0269] If the output image agent binder 1004' is notified 
25 that registration of documents is completed, the output 



- 78 - 



image agent binder 1004' notifies the output image agent job 
1003' that all binders have been established (S5061) . The 
output image agent job 1003' notifies the image conversion 
job 1001a that the binders have been established (S5062) . 
5 [0270] If the image conversion job 1001a is notified that 

the binders have been established, the image conversion job 
1001a notifies the input image agent job 1003 that the 
binders have been established (S5063) . 

[0271] If the input image agent job 1003 is notified that 
10 the binders have been established, the input image agent job 

1003 notifies the input image agent binder 1004 that there 

is no more document to be registered (S5064) . 

[0272] In response to receiving the notification 

indicating that registration of documents is completed, the 
15 input image agent binder 1004 notifies the input image agent 

job 1003 that the binders have been established (S5065) . 

The input image agent job 1003 notifies the image conversion 

job 1001a that the binders have been established (S5066) . 

[0273] In response to the notification, the image 
20 conversion job 1001a notifies the imaging job 1026 that the 

binders have been established (S5067) . 

[0274] Thereafter, the protocol interpreter 701 notifies 
the image conversion job 1001a that the job script has been 
ended (S5068) . In response to receiving the notification of 
25 the end of the job script, the image conversion job 1001a 
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notifies the output image agent job 1003' that the job 
script has been ended (S5069) . If the output image agent 
job 1003' receives the notification of the end of the job 
script, the output image agent job 1003' notifies the image 
5 conversion job 1001a that the job has been established 

(S5070) . 

[0275] If the image conversion job 1001a receives the 
notification of the establishment of the job, the image 
conversion job 1001a notifies the input image agent job 1003 

10 that the job script has been ended (S5071) . If the input 

image agent job 1003 receives the notification of the end of 
the job script, the input image agent job 1003 notifies the 
image conversion job 1001a that the job has been established 
(S5072) . In response to receiving the notification, the 

15 image conversion job 1001a notifies the imaging job 1026 

that the job script has been ended (S5073) . 

[0276] On the other hand, if storing of image data in the 
image conversion process started in step S5056 is completed, 
the output image document 1011 1 stores attribute information 

20 associated with the resultant image data into the document 

manager 900 (S5074) . If storing of the attribute 
information is completed, the output image agent document 
1005' is notified that storing of the attribute information 
is completed (S5075) . 

25 [0277] In response to receiving the notification of the 
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completion of storing of the attribute information, the 
output image agent document 1005' notifies the output image 
agent binder 1004' that storing of the attribute information 
is completed (S5076) . In response, the output image agent 
5 binder 1004' stores attribute information associated with 

the binder into the document manger 900 (S5077) . 
[0278] After completion of storing the attribute 
information associated with the binder, the output image 
agent binder 1004' notifies the output image agent job 1003' 
10 that storing of the attribute information is completed 

(55078) . 

[0279] In response, the output image agent job 1003' 
stores attribute information into the document manager 900 

(55079) . After completion of storing the attribute 

15 information, the output image agent job 1003' notifies the 

image conversion job 1001a that storing of the attribute 
information is completed (S5080) . 

[0280] In response, the image, conversion job 1001a 
notifies the protocol interpreter 701 that the reading is 

20 completed (S5081) . 

[0281] The protocol interpreter notifies the external job 
issuer (i.e., a host computer on the network or the 
operation control unit) that the scanning is completed. 
This makes it possible for the job issuer to recognize that 

25 the converted image data has been stored and to know where 
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the converted image data is stored. 

[0282] Via the process described above, image data read 
by the scanner can be converted into preview image data. 
The obtained preview image data is stored in the image 
5 storage unit 160 via the document manger 900. A preview 

image of a desired image data can be displayed in the 
preview image display screen by specifying the storage 
location thereof. 

[0283] The manner of dealing with document data obtained 
10 via the reading process in the binding reading mode 

performed by the reader unit 200 has been described above. 
When document data to be printed is received from a host 
computer 601 or the like, the document data may be dealt 
with in a similar manner. That is, the image processing 
15 apparatus may have an input-all- first mode in which the 

controller controls the inputting of document data to be 
printed from the host computer 601 or the like in a similar 
manner to the binding. reading mode. However, in this case, 
"document data" and "image data" in the flow charts shown in 
20 Figs. 8, 9, and 10 should be considered as "data to be 

printed", and "read" should be considered as "input from the 
host computer" . 

[0284] Referring to a memory map shown in Fig. 20, data 
processing programs that are read and executed by the image 
25 processing apparatus according to the present invention are 
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described below. 

[0285] Fig. 20 is a diagram showing a memory map of a 
storage medium in which various data processing programs are 
stored in a manner readable by the image processing 
5 apparatus according to the present invention. 

[0286] Although not shown in Fig. 20, in some cases, 
information necessary for management of the programs stored 
in the storage medium, such as information indicating 
versions of programs or names of authors of programs, is 

10 also stored in the storage medium. Furthermore, information 

such as icons for identifying the respective programs, 
depending on the OS executed on the electronic device that 
reads the programs, may also be stored in the storage medium. 
[0287] Furthermore, data associated with the respective 

15 programs are stored and managed in directories in the 

storage medium. Also, in some cases, a program used to 
install a program onto a computer is also stored in the 
storage medium. In a case in which a program to be 
installed onto the computer is stored in a compressed 

20 fashion, a program used to decompress the program is also 

stored. 

[0288] The functions or the capabilities described above 
with reference to Figs. 8 to 10 may be implemented by 
programs installed from the outside onto a host computer. 
25 In such a case, the present invention can be applied to a 
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system in which information including such programs is 
supplied to an output device from a storage medium such as a 
CD-ROM, flash memory, or floppy disk (FD) or from an 
external storage medium via a network. 
5 [0289] The objects of the present invention may also be 

achieved by supplying a storage medium, on which a software 
program implementing the functions of any of the embodiments 
described above is stored, to a system or an apparatus 
whereby a computer (CPU or MPU) in the system or apparatus 
10 reads and executes the program code stored on the storage 

medium. 

[0290] In this case, it should be understood that the 
program code read from the storage medium implements the 
functions of invention and thus the storage medium storing 

15 the program code falls within the scope of present invention. 

[0291] Specific examples of storage media that can be 
preferably employed in the present invention to supply the 
program code include a floppy disk, hard disk, optical disk, 
magneto-optical disk, CD-ROM, CD-R, magnetic tape, 

20 nonvolatile memory card, ROM, and EE PROM . 

[0292] Furthermore, the scope of the present invention 
includes not only such an apparatus in which the functions 
of any embodiment described above is implemented simply by 
reading and executing a program code on a computer but also 

25 an apparatus in which a part of or the whole of process is 
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performed by a OS (operating system) running on the computer 
in accordance with the program code. 

[0293] Furthermore, the scope of the present invention 
also includes an apparatus /system in which a program code is 
5 transferred once from a storage medium into a memory 

provided in a function extension board inserted in a 
computer or provided in a function extension unit connected 
to the computer, and then a part of or the whole of process 
is performed by a CPU or the like in the function extension 
10 board or the function extension unit in accordance with the 

program code thereby implementing the functions of any 
embodiment described above. 

[0294] Although the present invention has been described 
above with reference to preferred embodiments, the present 

15 invention is not limited to those specific embodiments 

described above, but various modifications, including 
combinations of embodiments, are possible. 
[0295] For example, the present invention may also be 
implemented in aspects described below. 

20 [0296] Aspect 1. An image processing apparatus 

comprising image reading means (i.e., the scanning unit 210 
shown in Fig. 1) for reading one page of a document or 
sequentially scanning a plurality of pages of a document and 
producing image data thereof, image storage means (i.e., the 

25 image storage unit 160 shown in Fig. 1) for storing the 
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image data read by the image reading means, document 
management means for managing the image data stored in the 
image storage means, print means (i.e., the printer unit 300 
shown in Fig. 1) for printing particular image data managed 
5 by the document management means, mode setting means (i.e., 

the operation control unit 150 shown in Fig. 1) for setting 
various modes. The image processing apparatus further 
comprising reading means (i.e., the controller 110 shown in 
Fig. 1) for reading all document pages first by repeating a 

10 process of reading one or more document pages at a time 

using the image reading means and storing the resultant 
image data into the image storage means, preview image 
display means for producing preview image data corresponding 
to image data obtained via the process of reading all 

15 document pages and stored in the image storage means and 

displaying the produced preview image data on a display, and 
document re-reading means (i.e., the controller 110 shown in 
Fig. 1) for discarding a selected page of image data 
displayed on the image display means and inserting image 

20 data of a document page re-read by the image reading means 
at the page location at which the discarded page of the 
image data was stored. 

[0297] Aspect 2. An image processing apparatus according 
to aspect 1, wherein the preview image display means 
25 performs a particular conversion on the image data and 
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displays a preview image of the resultant image data on the 
display. 

[0298] Aspect 3. An image processing apparatus according 
to aspect 1, wherein the image reading means includes a 
5 number-of -sheets control means for controlling the reading 

operation such that a specified number of document sheets 
are sequentially fed from a document set placed on the 
automatic document feeder (DF) and image data there of is 
read. 

10 [0299] Aspect 4. An image processing apparatus according 

to aspect 1, wherein the document management means manages 
image data and attribute information thereof stored in a 
storage device in unit of folders, jobs, binders, documents 
and pages, and wherein each folder manages one or more jobs, 

15 each job manages one or more binders, each binder manages 

one or more documents, and each document manages one or more 
pages . 

[0300] Aspect 5. An image processing apparatus according 
to aspect 1, further comprising protocol interpretation 

20 means for interpreting a protocol according to an operation 
command, job generation means for generating a job to be 
processed in accordance with the interpretation performed by 
the protocol interpretation means, and job processing means 
for processing the job generated by the job generation means. 

25 [0301] Aspect 6. An image processing apparatus according 
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to aspect 5, wherein the job processing means comprises job 
management means (i.e., the job manager 811 shown in Fig. 
12) for managing information associated with the entirety of 
a job and controlling execution of processing associated 
5 with the entirety of the job, binder management means (i.e., 
the binder manager 812 shown in Fig. 12) for managing 
information associated with a binder and controlling 
execution of processing associated with the binder, document 
management means (i.e., the document manager 813 shown in 

10 Fig. 12) for managing information associated with a document 

and controlling execution of processing associated with the 
document, generation means (i.e., the document processor 820 
shown in Fig. 12) for generating a document, document 
processing means for processing the document generated by 

15 the document generation means, page generation means (i.e., 

the page processor 830 shown in Fig. 12) for dividing the 
document generated by the document generation means into 
pages, page processing means (i.e., the page processor 830 
shown in Fig. 12) for processing a page generated by the 

20 page generation means, band generation means (i.e., the band 

processor 840 shown in Fig. 12) for dividing the page 
generated by the page generation means into bands, band 
processing means (i.e., the band processor 840 shown in Fig. 
12) for processing the bands generated by the band 

25 generation means, and device allocation means (i.e., the 
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device allocator 850 shown in Fig. 12) for arbitrating 
requests for usage of a device necessary in execution of the 
job. 

[0302] Aspect 7. An image processing apparatus according 
5 to aspect 6, wherein the job generated by the job generator 

includes one or more binders, each binder includes one or 
more documents, each document includes one or more pages, 
and each page includes one or more bands. 

[0303] Aspect 8. An image processing apparatus according 
10 to aspect 6, wherein the document processing means 

determines processing to be performed in accordance with a 
determined format of input data and a determined format of 
output data. 

[0304] Aspect 9. An image processing apparatus according 
15 to aspect 6, wherein the page processing means determines 

processing to be performed in accordance with a determined 

format of input data and a determined format of output data. 

[0305] Aspect 10. An image processing apparatus 

according to aspect 6, wherein the band processing means 
20 determines processing to be performed in accordance with a 

determined format of input data and a determined format of 

output data . 

[0306] Aspect 11. An image processing method for an 
image processing apparatus comprising image reading means 
25 for scanning one page of a document or sequentially scanning 
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a plurality of pages of a document and producing image data 
thereof, image storage means for storing the image data 
produced by the image reading means, document management 
means for managing the image data stored in the image 
5 storage means, print means for printing particular image 

data managed by the document management means, and setting 
means for setting various modes, wherein the image 
processing method comprising the steps of a reading step 
(step S1004 in Fig. 8) of reading all document pages first 

10 by repeating a process of reading one or more document pages 

at a time using the image reading means and storing the 
resultant image data into the image storage means, a preview 
image display step (step S1005 in Fig. 8) of producing 
preview image data corresponding to image data obtained via 

15 the reading step of reading all document pages and stored in 

the image storage means and displaying the produced preview 
image data on a display, and a document re-reading step 
(step S1006 shown in Fig. 8) for discarding a selected page 
of image data displayed on preview image display means and 

20 inserting image data of a document page re-read by the image 

reading means at the page location at which the discarded 
page of the image data was stored. 

[0307] Aspect 12. An image processing method according 
to aspect 11, wherein the step of displaying scanned image 
25 date includes the steps of performing a predetermined 
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conversion on the image data and displaying a preview image 
of the resultant image data on the display. 

[0308] Aspect 13. An image processing method according 
to aspect 11, further comprising the step of specifying the 
5 number of document sheets to be fed from a set of document 

sheets placed on an automatic document feeder (DF) . 
[0309] Aspect 14. An image processing method according 
to aspect 11, wherein the document management means manages 
image data and attribute information thereof stored in a 

10 storage device in unit of folders, jobs, binders, documents 

pages, each folder manages one or more jobs, each job 
manages one or more binders , each binder manages one or more 
documents, each document manages one or more pages. 
[0310] Aspect 15. An image processing method according 

15 to aspect 11, further comprising the steps of interpreting a 

protocol according to an operation command, generating a job 
to be processed in accordance with the interpretation 
performed in the protocol interpretation step, and 
processing the job generated in the job generation step. 

20 [0311] Aspect 16. An image processing method according 

to aspect 15, wherein the job processing step (step S4003 
and the following steps shown in Fig. 16) includes a job 
management step (step S4010 and the following steps 
performed by the image agent job 1003 shown in Fig. 16, step 

25 S4004 and the following steps performed by the scan job 1002, 



and step S4007 and the following steps performed by the 
print job 1006) of managing information associated with the 
entirety of a job and controlling execution of processing 
associated with the entirety of the job; a binder management 
step (step S4017, step S4010 and the following steps 
performed by the image agent binder 1004 shown in Fig. 16, 
and steep S4097 and the following steps performed by the 
print binder. 1007) of managing information associated with a 
binder and controlling execution of processing associated 
with the binder, a document management step (step S4027 and 
the following steps performed by the image agent document 
1005 shown in Fig. 16, and step S4100 performed by the print 
document 1008) of managing information associated with a 
document and controlling execution of processing associated 
with the document, a document generation step (steps S402 8, 
S4037, and S4102 shown in Fig. 16) of generating a document, 
a document processing step (steps S4030, S4040, and S4105 
shown in Fig. 16) of processing the document generated in 
the document generation step, a page generation step of 
dividing the document generated in the document generation 
step into pages, a page processing step of processing a page 
generated in the page generation step, a band generation 
step of dividing the page generated in the page generation 
step into band, a band processing step of processing a band 
generated in the band generation step, and a device 
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allocation step of arbitrating requests for usage of a 
device necessary in execution of the job. 

[0312] Aspect 17. An image processing method according 
to aspect 16, wherein the job generated in the job 
5 generation step includes one or more binders, each binder 

includes one or more documents, each document includes one 
or more pages, and each page includes one or more bands. 

[0313] Aspect 18. An image processing method according 
to aspect 16, wherein the document processing step includes 
10 the step of determining processing to be performed is 

determined in accordance with a determined format of input 
data and a determined format of output data. 

[0314] Aspect 19. An image processing method according 
to aspect 16, wherein the page processing step includes the 
15 step of determining processing to be performed is determined 

in accordance with a determined format of input data and a 
determined format of output data. 

[0315] Aspect 20. An image processing method according 
to aspect 16, wherein the band processing step includes the 
20 step of determining processing to be performed is determined 

in accordance with a determined format of input data and a 
determined format of output data. 

[0316] Aspect 21. A computer-readable storage medium on 
which a program for implementing an image processing method 
25 in one of Aspects 11 to 20 is stored. 
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[0317] Aspect 22. A program for implementing an image 
processing method in one of Aspects 11 to 20. 
[0318] According to the embodiments or the aspects 
described above, image data can be previewed even in the 
5 middle of the process of reading document pages in the 

binding reading mode in which reading a smaller number of 
document sheets than the maximum number of sheets allowed to 
be placed on the document tray is performed repeatedly until 
all pages of a given set of document sheets have been read. 

10 If an error is detected in a preview image corresponding to 

a particular page of image data, only that particular page 
is re-read without having to re-read all pages. In this 
technique, because an error can be detected before reading 
is completed for all pages, a drastic improvement in 

15 operation efficiency is achieved. Furthermore, it is not 

necessary to perform test printing to confirm that reading 
of image data has been correctly performed, and thus 
printing paper is not wasted. 

[0319] As described above, according to the present 
20 invention, it is possible to preview image data even in the 

middle of the process of reading document pages in the 
binding reading mode in which reading a smaller number of 
document sheets than the maximum number of sheets allowed to 
be placed on the document tray is performed repeatedly until 
25 all pages of a given set of document sheets have been read. 



- 94 - 



If a particular page of image data has an error, the error 
can be easily detected from a corresponding preview image, 
and the particular page can be easily re-read. The 
particular page of image data having the error is discarded 
5 and the image data obtained by re-reading is inserted in the 

place of the discarded page. After completion of re-reading, 
reading of the remaining pages of document can be continued 
in the binding reading mode. This leads to a drastic 
improvement in operation efficiency. That is, the present 
10 invention provides an excellent operational environment in 

which reading of document sheets is performed in a flexible 
and highly efficient manner depending on the requirement 
issued by a user. 

[0320] In another embodiment of the present invention, the 
15 interval during which the reading operation is suspended, 

preview images are displayed, and the reading operation is 
resumed can be established via manual means. For example, a 
"Suspend" button would be provided on the user interface of 
Fig. 5, wherein selection of this button by a user would 
20 result in suspension of the reading operation and the user 

would be provided the option of displaying preview images. A 
"Resume" button would be provided on the user interface of 
Fig. 5, wherein selection of this button by a user would 
result in resumption of the reading operation. Any other 
25 means of manually suspending the reading operation, 
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displaying preview images, and resuming the reading 
operation that would enable practice of the present 
invention is applicable. 

[0321] It is to be understood that the phraseology or 
5 terminology employed herein is for the purpose of 

description and not of limitation. While the invention has 
been described with reference to the structures disclosed 
herein, it is not confined to the details set forth and this 
application is intended to cover such modifications or 
10 changes as may come within the purposes of the improvements 

or the scope of the following claims. 



